Description
ETL/Azure Data Developer/Engineer required for a 10 month contract assignment. The role will be based remotely for now but in the future you will be required to spend time onsite in Denmark.
In the role you will assist in the development of:
- automated ingest and versioning of data for Analytics environments
- automated ETL processes to transform data from the platform and load into analytics environments using Azure Pipelines and Azure Data Factory.
- functionality, consulting and configuration/configuration of relevant cloud services, such as Azure Data Factory and AzureDatabricks.
The ideal candidate for the role should have skills/experience of:
- writing/developing ETL and ETL processes
- setting up and using AzureData Factory or similar tools
- AzureDatabricks
- relevant programming languages such as Python, R, Scala, as well as Scripting languages such as bash and powershell; knowledge of Azure CLI and Azure powershell
- Knowledge of the configuration and use of Azure Machine Learning in different environments (dev, test, train, preprod and prod). In particular, knowledge of AML pipelines, and concepts for data management and versioning.
- the establishment of data flows and the versioning of data in terms of development, training and commissioning of Analytics models (DataOps).
- the establishment of versioning and deployment of ML models (MLOps).
- Azure storage technologies such as Azure Data Lake
- SQL (T-SQL)
- security and secret management on major data platform projects.