Description
For our prestigious customer, we are currently looking for a Senior Data Engineer for a 3 month project (with the high likelihood of extension) in the Netherlands. The consultant will need programming experience in Python, whilst also having experience within DevOps environments (Kubernetes/DevOps.) and knowledge of working with Azure.
You will be joining a DevOps team that maintains a couple of data pipelines, datalake/datastorages, a data processing platform (Kubernetes) and a Postgres/PostGIS database. The team works Agile Scrum style.
For this Senior Data Engineering position, we are looking for someone with a strong software engineer or system administration background, who can implement the pipelines for the data scientists to use.
Responsibilities
- Implementing GDPR retention-policy to ensure that privacy-sensitive data is deleted in time.
- Implementing test data-policy .
- Implementing cost savings by ensuring that Dev, Test and Acc environments scale down outside office hours.
Your Profile
- Azure
- Experience with Python
- Experience with Docker/Kubernetes
- Experience with Java/Scala, Spark, Kafka
- Demonstrated experience as a Data Engineer would be a nice to have
- Experience with Spring Boot, C#, Airflow and Linux would also be beneficial
- English speaking project
- Dutch would be a nice to have
If you have right skill-set and are interested in applying, please send over your up to date CV for immediate consideration.