Description
Data Engineer x 2 (Big Data)
Location: Newport, South Wales
Outside IR35
Duration: 9 month contract role
Start: ASAP
Rate: £neg.
*SC CLEARANCE IS REQUIRED*
We require two Data Engineers for our Client based in Newport, South Wales.
Good inter-personal and communication skills.
Self-starter eg problem solving and taking initiative to sort out issues;
A quick learner, able to assimilate the complexities of unfamiliar data sources and business data requirements
Flexibility in being able to work on several projects at the same time.
Skills and Experience Essential
Extensive proven experience of data engineering and architectural techniques, including data wrangling, data profiling, data preparation, metadata development and data upload/download
Proven experience of 'big data' environments, including the Hadoop Stack (Cloudera), including data ingestion, processing and storage using HDFS, Spark, Hive and Impala;
Extensive hands-on experience of developing ETL functionality in a cloud or on-premise environment Experience of using tools such as python and SQL (in Spark) to profile, query and structure large-volume data;
Proven experience of using Cloud Services particularly in the context of Hadoop;
Experience of developing/utilising programming and query languages eg SQL (Hive Impala specifically), Python (through Spark), Scala.
SC-level clearance valid for at least 1 year on commencement of the contract;
Understanding of data bases and applying data models.
Desirable
Experience of coaching and training others in programming and ETL techniques;
Experience of UK Government Administrative Data;
Please send in your CV.