03/01/2026 updated
100 % available
Senior Data Platform Engineer
Amsterdam, Netherlands
Only remote
PhD in Information Technology (AI & Graph Theory)Apache AirflowArchitectureArchitectural DesignMicrosoft AzureCloud ComputingComputer ProgrammingData GovernanceData InfrastructureExtract Transform Load (ETL)Data SystemDialectical Behavior TherapyDisaster RecoveryGitHubPython (Programming Language)Azure SQL
Cloud Data Platform Architecture
Design and implementation of scalable cloud-based data infrastructure using Azure Data Factory, Databricks, and Delta Lake with medallion architecture for high-throughput environments
Real-time Data Processing
Development of ETL/ELT pipelines and streaming data solutions using Kafka, Spark Structured Streaming, and PySpark for processing terabytes of data daily
Data Governance and Quality
Implementation of data governance frameworks, quality monitoring, and compliance measures including GDPR compliance and disaster recovery strategies
Azure Services Expertise
Comprehensive knowledge of Azure Data Lake Storage, Azure SQL Database, Azure Monitor, and Azure DevOps for cloud infrastructure management
Programming and Development
Proficiency in Python, SQL, dbt, and Flask for data processing and application development
Infrastructure as Code
Implementation of Terraform, Docker, Kubernetes, and CI/CD pipelines using Jenkins and GitHub Actions
Data Orchestration
Experience with Apache Airflow and Azure Data Factory for workflow orchestration and pipeline management
Monitoring and Operations
Setup of observability dashboards, system availability monitoring, and log analytics for operational excellence
Design and implementation of scalable cloud-based data infrastructure using Azure Data Factory, Databricks, and Delta Lake with medallion architecture for high-throughput environments
Real-time Data Processing
Development of ETL/ELT pipelines and streaming data solutions using Kafka, Spark Structured Streaming, and PySpark for processing terabytes of data daily
Data Governance and Quality
Implementation of data governance frameworks, quality monitoring, and compliance measures including GDPR compliance and disaster recovery strategies
Azure Services Expertise
Comprehensive knowledge of Azure Data Lake Storage, Azure SQL Database, Azure Monitor, and Azure DevOps for cloud infrastructure management
Programming and Development
Proficiency in Python, SQL, dbt, and Flask for data processing and application development
Infrastructure as Code
Implementation of Terraform, Docker, Kubernetes, and CI/CD pipelines using Jenkins and GitHub Actions
Data Orchestration
Experience with Apache Airflow and Azure Data Factory for workflow orchestration and pipeline management
Monitoring and Operations
Setup of observability dashboards, system availability monitoring, and log analytics for operational excellence
Project history
Designed and implemented data pipelines using Azure Data Factory and Databricks, building ETL/ELT processes for fintech decision-support systems. Built real-time data infrastructure with medallion architecture and managed feature stores for production data pipelines.
Built and maintained PySpark/dbt workflows processing 6 TB/day. Served as primary IC on Hadoop to cloud migration for finance datasets and architected data lake solutions for structured and unstructured financial datasets.
Orchestrated real-time ETL pipelines for daily transactions using Kafka and Spark Structured Streaming. Built ETL/ELT processes transforming raw transaction data into analytics-ready formats for finance and compliance teams.