Description
Role: Senior Data Engineer Azure
Location: 100% remote
Start date: end of February - beginning of march 2021
Duration: long term
Language: English
Our customer is a consultancy, well known for their high standards and quality of delivery, rolling out a brand new data analytics platform for a large international retailer.
The retailer will utilise the Azure PaaS platform to build an advanced analytics platform for their omni-chancel interaction and commerce, as well as supply chain and IoT, in order to deliver stronger and more accurate insights to the business. The platforms are used continuously and are improved to support other capabilities such as data science, machine learning and AI.
In the team an opportunity has arisen for a Senior Data Engineer with strong expertise in Azure to join.
Your role:
- You will design and implement batch and Real Time data ingestion pipelines for Azure Data Lake
- Implement data quality checks and data lineage & reconciliation mechanisms (incl monitoring dashboards and alerts)
- Implement data cataloguing, archiving and disaster recovery
- Working with other teams to align on data structures and schemas
Must have skills:
- Azure SQL, Azure Data Lake, Azure Databricks, Azure Data Factory. Azure Analysis Services
- Experience with implementing data ingestion pipelines/ETLs and ELTs
- General knowledge of Azure platform and Ecosytem