12/27/2025 updated
100 % available
Senior Data Engineer with Azure and Big Data Expertise
Eindhoven, Netherlands
Only remote
Bachelor of Engineering in Computer ScienceAbout me
Experienced Data Engineer with 7 years of experience Skilled : Python, Pyspark ,Azure Data lake , Azure Data factory, Azure Databricks, Azure Devops , Azure Keyvault , Azure Functions , Azure Event Hub , Azure IOT hub , Azure Service Bus , .Batch and streaming data, SQL, Data Warehousing, powerbi
Controles de AccesoData AnalysisAutomationMicrosoft AzureBusiness IntelligenceBig DataContinuous IntegrationInformation EngineeringExtract Transform Load (ETL)Data ModelingData SecurityData WarehousingDevOpsDimensional ModelingGitHub
Azure Data Platform Development
Comprehensive expertise in Azure Data Factory, Data Lake, Azure Data Flow, and Databricks for building scalable data pipelines and implementing ETL processes across multiple industry domains
Big Data Processing and Analytics
Advanced proficiency in SQL, Python, PySpark, and Spark optimization techniques for handling large-scale structured and unstructured data with performance tuning capabilities
Data Pipeline Orchestration
Extensive experience in designing and implementing robust data pipelines using Azure Data Factory with SCD Type 2 standards, automated scheduling mechanisms, and full history capture
IoT and Digital Twin Solutions
Development of IoT data pipelines and Digital Twin solutions using Azure IoT Hub, Event Hub, Function Apps, and Azure Stream Analytics for real-time sensor data processing
Data Security and Governance
Implementation of Unity Catalog for Databricks Workspace with Row-Level Security, Column-Level Security, and fine-grained access controls at catalog, schema, and table levels
Business Intelligence and Visualization
Power BI dashboard development on Delta tables for predictive analytics, operational monitoring, and stakeholder reporting with automated refresh mechanisms
DevOps and CI/CD Practices
Experience with Git, GitHub, Azure DevOps, and CI/CD pipelines for automated deployments and version control in data engineering projects
Data Warehousing and Modeling
Expertise in Data Modeling, Schema Design including Star Schema and Snowflake Schema for Relational and Dimensional Modeling concepts
Comprehensive expertise in Azure Data Factory, Data Lake, Azure Data Flow, and Databricks for building scalable data pipelines and implementing ETL processes across multiple industry domains
Big Data Processing and Analytics
Advanced proficiency in SQL, Python, PySpark, and Spark optimization techniques for handling large-scale structured and unstructured data with performance tuning capabilities
Data Pipeline Orchestration
Extensive experience in designing and implementing robust data pipelines using Azure Data Factory with SCD Type 2 standards, automated scheduling mechanisms, and full history capture
IoT and Digital Twin Solutions
Development of IoT data pipelines and Digital Twin solutions using Azure IoT Hub, Event Hub, Function Apps, and Azure Stream Analytics for real-time sensor data processing
Data Security and Governance
Implementation of Unity Catalog for Databricks Workspace with Row-Level Security, Column-Level Security, and fine-grained access controls at catalog, schema, and table levels
Business Intelligence and Visualization
Power BI dashboard development on Delta tables for predictive analytics, operational monitoring, and stakeholder reporting with automated refresh mechanisms
DevOps and CI/CD Practices
Experience with Git, GitHub, Azure DevOps, and CI/CD pipelines for automated deployments and version control in data engineering projects
Data Warehousing and Modeling
Expertise in Data Modeling, Schema Design including Star Schema and Snowflake Schema for Relational and Dimensional Modeling concepts
Experience
Professional experience5 - 10 years
Freelancer since2025
Languages
EnglishFluent
Project history
Designed and implemented scalable IoT data pipelines for multi-source sensor data integration, developed Power BI dashboards for Wells Operations, and architected GenAI-based predictive solutions on Databricks Delta tables
Implemented Medallion Architecture for data ingestion and transformation, designed Data Quality validation notebooks, and developed Azure Data Factory pipelines for automated data processing workflows
Worked on Data Migration for CPG domain using Azure services in multi-hop architecture, extracted data from various sources, and participated in full development life cycle from requirement gathering to deployment