Data Engineer

GB  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Description

I'm recruiting for a Data Engineer - AWS for a global agile tech consultancy. Further details below

  • Location: Fully Remote
  • Day Rate: £.00 for 6 months
  • Inside IR35
  • Start date: ASAP

Data Engineer Qualifications

  • Experience with SQL
  • Experience with data ingestion practices and tools such as Informatica, StreamSets or Apache NiFi
  • Experience of BI tools and Data processing frameworks such as Apache Spark - preferably using Python (PySpark) or Scala
  • Experience with Data visualisation technologies
  • Experience in writing data processing jobs in notebook environments such as Zeppelin, Jupyter
  • Knowledge of HDFS, Object store and the various serialisation formats such as Parquet, ORC, Avro, Protobuf etc.
  • Experience with architecting/designing data solutions
  • Knowledge of CI/CD in relation to the data engineering pipelines Comment - this capability in D & A is not very mature at the moment
  • Unix and Active Directory (Kerberos particularly)
  • AWS experience

If you feel you have the skills please submit your CV and I will be in touch regarding the short interview process

Xpertise acts as an employment agency

Start date
ASAP
Duration
6 months
From
Xpertise
Published at
28.10.2021
Project ID:
2238689
Contract type
Freelance
To apply to this project you must log in.
Register