Description
Data Engineer - 12 months - Brussels
One of our client is currently looking for a Data Engineer for a 12 months contract in Brussels. The rate is negotiable.
Please find the description below:
Data Engineer
Essential Job Functions:
- Designing and implementing batch and Real Time data ingestion pipelines for Azure Data Lake or similar cloud based (eg AWS/CGP) data warehouse or data lake solutions
- Implementing data quality checks
- Implementing data lineage and reconciliation mechanisms (including monitoring dashboards and alerts)
- Implementing data cataloguing, archiving and disaster recovery
- Working with data source and data consumption teams to align on data structures and schemas
Mandatory Skills:
- Familiarity with modern, cloud based data/BI technologies (data lakes, data warehouses, ETL/ELT, Spark)
- Experience with implementing data ingestion pipelines/ETLs/ELTs
- General knowledge of Azure or comparable platform and ecosystem - Storage Account, CosmosDB (SQL & Gremlin API), Event Hub, App Services
- Experience with at least 3 of following Azure data technologies, or similar technologies for competitive Cloud technologies: Azure SQL, Azure Data Lake, Azure Databricks (SQL or Python, Delta Lake), Azure Data Factory, Azure Analysis Services
- Experience with SQL, Python
To be considered, please send me your latest CV and I will contact you for more details.