Senior Data Engineer/DataOps - Python/Azure/Kubernetes

Job type:
on-site
Start:
ASAP
Duration:
3 month+ (ext likely)
From:
Orcan Intelligence
Place:
NL
Date:
01/21/2020
Country:
flag_no Netherlands
project ID:
1878398

Warning
This project is archived and not active any more.
You will find vacant projects in our project database.

For our prestigious customer, we are currently looking for a Senior Data Engineer for a 3 month project (with the high likelihood of extension) in the Netherlands. The consultant will need programming experience in Python, whilst also having experience within DevOps environments (Kubernetes/DevOps.) and knowledge of working with Azure.

You will be joining a DevOps team that maintains a couple of data pipelines, datalake/datastorages, a data processing platform (Kubernetes) and a Postgres/PostGIS database. The team works Agile Scrum style.

For this Senior Data Engineering position, we are looking for someone with a strong software engineer or system administration background, who can implement the pipelines for the data scientists to use.

Responsibilities

  • Implementing GDPR retention-policy to ensure that privacy-sensitive data is deleted in time.
  • Implementing test data-policy .
  • Implementing cost savings by ensuring that Dev, Test and Acc environments scale down outside office hours.

Your Profile

  • Azure
  • Experience with Python
  • Experience with Docker/Kubernetes
  • Experience with Java/Scala, Spark, Kafka
  • Demonstrated experience as a Data Engineer would be a nice to have
  • Experience with Spring Boot, C#, Airflow and Linux would also be beneficial
  • English speaking project
  • Dutch would be a nice to have

If you have right skill-set and are interested in applying, please send over your up to date CV for immediate consideration.