Senior Data Engineer

England  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Description

Job Title: Senior Data Engineer
Location: Remote (ideally within distance of either London, Reading, Manchester, or Birmingham)
Salary/Rate: up to £600 per day INSIDE IR35
Start Date:
Job Type: Contract

Company Introduction
Brilliant opportunity now available with one of our sector-leading media & broadcasting clients! They are currently looking for a skilled Senior Data Engineer to join their team for a three-month contract.

Job Responsibilities/Objectives

Use cutting edge technology on GCP to build world class data pipelines (both batch & Real Time) and data services.
Build and maintain a self-service platform to help Datamodelling teams to be as self-sufficient as possible without needing to worry about infrastructure and deployment.
Work with highly skilled DevOps Engineers, ML Engineers, Data Scientists and Software Engineers side by side to build powerful data products and services (including MLOps) that would really improve the customer experience.
Work in a start-up like environment.
Tech in use: Apache Airflow on Cloud Composer, Apache Beam on Cloud Dataflow, DBT (Data Build Tool), Cloud Function, Firestore in Datastore mode, Pubsub, BigQuery, Cloud Storage, Terraform, GitLab and other tech if it makes sense.

Required Skills/Experience
The ideal candidate will have the following:

A team player and have excellent communication skills.
Have a good understanding of Agile. Not limited to frameworks or methodologies but what works best for the team.
Have a good understanding of SOLID principles, not what it says but how and when to apply them.
Can write clean and testable code, even without doing TDD.
Have a solid understanding of distributed computing.
Strong proficiency in Python with proven Data Engineering experience.
Strong SQL skills including analytic functions.
Have used Apache Airflow and maintained production pipelines.
Worked in a high data volume environment.
Experience with Apache Beam on a production environment.
Experience working on a GCP production environment is essential.
Experience working on a GCP production environment with Cloud Composer, Cloud Dataflow, Cloud PubSub and Cloud Firestore in Datastore mode and DLP will be a plus.

Contact Information
If you are interested in this opportunity, please apply now with your updated CV in word/PDF format.

Disclaimer
Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.

Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.

Start date
01/11/2021
Duration
13 weeks
From
Square One Resources
Published at
24.10.2021
Project ID:
2235730
Contract type
Freelance
To apply to this project you must log in.
Register