Description
Data Engineer (Remote or London/12 Months/£63.47 P/H PAYE)
A global Powerhouse within the social media industry is looking for a Data Engineer to join their team on an initial 12 month contract. The role will be onboarded remotely before joining the team in London.
They are looking for a Data Engineer to not only build data pipelines but also extend the next generation of their data tools. As a Data Engineer, you will develop a clear sense of connection with their organisation and leadership - as Data Engineering is the eyes through which they see the product. As a member of Infrastructure Strategy Data Engineering, you will belong to a centralised Data Science/Data Engineering team who partners closely with teams in the Infrastructure organisation. Through the consulting-nature of their team, you will contribute to a variety of projects and technologies, depending on partner needs.
Projects include analytics, ML modelling, tooling, services, and more.
Responsibilities
- Partner with leadership, engineers, program managers and data scientists to understand data needs.
- Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and Real Time systems.
- Communicate, at scale, through multiple mediums: Presentations, dashboards, company-wide datasets, bots and more.
- Educate your partners: Use your data and analytics experience to 'see what's missing', identifying and addressing gaps in their existing logging and processes.
- Broad range of partners equates to a broad range of projects and deliverables: ML Models, datasets, measurements, services, tools and process.
- Leverage data and business principles to solve large scale web, mobile and data infrastructure problems.
- Build data expertise and own data quality for your areas.
Minimum Qualifications
- Strong SQL skills are a MUST
- Datamodelling skills are a MUST and considered a portion of the SQL signals we look for
- Coding, should have familiarity with major concepts and a comfort level with at least one language of the candidate's choice
- Problem Solving is required Partnership is less of a thing here as most of the work will be directed by FTE Data Engineers, however this is a PLUS if the candidate exhibits good soft skills
- 5+ years of Python development experience.
- 5+ years of SQL experience.
- 3+ years of experience with workflow management engines (ie Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
- 3+ years' experience with Datamodelling. Experience analysing data to discover opportunities and address gaps.
- 5+ years' experience in custom ETL design, implementation and maintenance.
- Experience working with cloud or on-prem Big Data/MPP analytics platform (ie Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).
Preferred Qualifications
- Experience with more than one coding language.
- Designing and implementing Real Time pipelines.
- Experience with data quality and validation.
- Experience with SQL performance tuning and e2e process optimization.
- Experience with anomaly/outlier detection.
- Experience with notebook-based Data Science workflow.
- Experience with Airflow.
- Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.
Huntress Search Ltd acts as a Recruitment Agency in relation to all Permanent roles and as a Recruitment Business in relation to all Temporary roles.
PLEASE NOTE: We can only consider applications from candidates who have the right to work in the UK.