Data Engineer (SC Cleared)

Hampshire  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Description

My client are a prestigious government organisation based near Fareham, Hampshire. They are seeking a security cleared Data Engineer for contract engagement (outside IR35), initially until the end of March - with the strong possibility of extensions.

There is a need to provide central support to the Core Data Engineering Team around the development and processing of data deliveries from another government department as well as proving programming and data engineering support.

Skills and Experience

Essential

  • Extensive proven experience of data engineering and architectural techniques, including data wrangling, data profiling, data preparation, metadata development, and data upload/download;
  • Proven experience of 'big data' environments, including the Hadoop Stack (Cloudera), including data ingestion, processing and storage using HDFS, Spark, Hive and Impala;
  • Extensive hands-on experience of developing ETL functionality in a cloud or on-premise environment;
  • Experience of using tools such as python and SQL (in Spark) to profile, query and structure large-volume data;
  • Proven experience of using Cloud Services particularly in the context of Hadoop;
  • Experience of developing/utilising programming and query languages eg SQL (Hive Impala specifically), Python (through Spark), Scala.
  • SC-level clearance valid for at least 6 months on commencement of the contract.
  • Understanding of data bases and applying data models in relational database formats.

Desirable

  • Experience of coaching and training others in programming and ETL techniques;
  • Experience of UK Government, particularly HMRC Administrative Data

Start date
ASAP
From
Concept Resourcing
Published at
15.01.2021
Project ID:
2028950
Contract type
Freelance
To apply to this project you must log in.
Register