Description
Data Engineer required for an initial 6 month contract working with a well established, progressive and growing data team, supporting the development of our Client's state of the art data platform and their bespoke data analytics application that are used across the business. Working alongside the Data Engineers, Data Scientists and Data Analysts to support business initiatives and drive growth this is an important role and you'll be a key player within the organisation!
Key responsibilities will include:
- Development of new data models, core data sets, data extractions, transformations and loading processes.
- Supporting existing process and own data quality
- Implement new data integrations and write custom plugins in Airflow
- Own and maintain the data architecture elements and its performance and security.
We are ideally looking for someone who has previous experience in developing on a big data cloud platform, experience in developing airflow pipelines on AWS or GCP, experience in developing pipelines using Python and experience in writing complex SQL statements and data transformations in SQL
Experienced with:
Airflow or Luigi, Jenkins, Cloud Composer, AWS Step functions
Hive, Hadoop, Spark, Presto, Athena, Redshift, BigQuery
This role can be worked entirely remotely so you can be living in Edinburgh, Glasgow, Manchester, Birmingham, Liverpool, London, Sussex, Surrey, Kent - anywhere within the UK.
If this sounds of interest, send your CV to ARC IT Recruitment for consideration
Remote Working
Initial 6 Month contract