Description
Data Engineer (Inside IR35) High paying rates
Signify Technologies client is one of the world's biggest liberal news organisations.
Data is central to the customer. It is used extensively across our business from journalism to safeguarding our financial future.
They work in an agile manner utilising DataOps and MLOps methodologies. They use GCP as our data platform supporting the development of our data assets and advanced analytical models.
The Data Engineer will:
- Mostly be programming in Python and/or Scala, Terraform, SQL and running in GCP, but we use the tool that best fits the problem.
- Work with data warehouse technologies including BigQuery, DataProc, Apache Spark, DBT and Cloud Composer (Apache Airflow).
- Contribute to implementation of our new data platform on GCP. Including using new tools within GCP.
- Build a new generation of tooling to support our data engineering projects.
- Be expected to conduct knowledge sharing on GCP through pairing, collaboration and coaching others across the department.
- Work in a multi-functional team, which is empowered to rapidly iterate and release new features.
- Not be coding in isolation - our culture is strongly collaborative, whether pair programming with other developers or working closely with editorial and commercial colleagues.
- Sometimes deciding what code to write is as hard as writing the code itself. As an engineer you'll be involved in product decisions as well as technical ones.
- Be encouraged to help others grow - you will pass on your expertise to other developers, whilst continuing to grow yourself.
About You
As a data engineer, you'll be equally willing to create data tools for analytics, insights and business performance metrics whilst building the infrastructure required for optimal extraction, transformation and loading of data.
- You have a minimum of one year experience working on GCP or significant data engineering experience in a similar environment.
- Ideally you are a certified GCP Data Engineer or you have significant data engineering experience on GCP.
- You have experience of MLOps and collaborating with data scientists to deploy models into production.
- You are comfortable working collaboratively with other teams. Including data science, data modellers and product engineering teams.
- You understand the importance of data quality and have familiarity with building high quality data assets.
- You are confident in translating product and business requirements into technical solutions.
- You have extensive experience building data pipelines for large datasets using ETL/ELT.
- You have an understanding of data modelling concepts (dimension, fact, and summary tables).
- You understand security best practice and have hands-on experience implementing it.
- You inspire the people you work with, and are inspired by them in return.
- You are excited by the opportunity to craft the future of digital journalism.
- You can make reasoned choices regarding what technologies to use and when to use them.