Data Platform Engineer (Go, SQL, Spark)

Rotterdam  ‐ Onsite

Keywords

SQL Databases Apache Spark Microsoft Azure Product Family Engineering Workflows Kubernetes Cloud Computing Continuous Integration Data Modeling Dutch Recruitment Infrastructure Management Stock Control Storage Systems Data Streaming User Stories Data Build Tool (dbt) Data Lake Terraform Databricks Microservices

Description

For one of my clients, one of the largest players in global shipping, I am looking for an experienced Data Platform Engineer. In this role you will pick up user stories to maintain, improve and extend the data capabilties provided by the platform. You have knowledge of Data Lakehouse solutions and associated data modeling techniques. You are familiar with Kubernetes, CI/CD in an (Azure) cloud environment and develop in Go, Spark and SQL.

Requirments:
  • Minimum of 5 years experience as a developer in Go, SQL, Spark, and Azure Cloud.
  • Demonstrated knowledge of Kubernetes, containerized workflows and microservices - experience with ArgoCD and Argo Workflows is a plus.
  • Demonstrated knowledge of setting up and maintaining Data Lakes and Warehouses - experience with Databricks is a big plus.
  • Experience building batch and streaming data ingest, processing and storage solutions.
  • Experience using Infrastructure as Code - demonstrable experience with Terraform is a plus.
  • Experience with Data Build Tool (dbt) is a plus.
  • Good command of the Dutch language is a plus, but English is also possible.


Darwin Recruitment is acting as an Employment Business in relation to this vacancy.
Start date
11.2024
Duration
12 months
From
Darwin Recruitment
Published at
26.09.2024
Contact person:
Florian Rebel
Project ID:
2800365
Industry
Transportation
Contract type
Freelance
To apply to this project you must log in.
Register