10/27/2024 updated
100 % available
Data Engineer with Azure and Python Expertise
Haarlem, Netherlands
Worldwide
Bachelor (Honours)Application Programming Interfaces (APIs)Agile MethodologyData AnalysisMicrosoft AzureBig DataCloud ComputingInformation EngineeringExtract Transform Load (ETL)Data QualityPython (Programming Language)Scrum MethodologySoftware EngineeringSQL DatabasesTransact-SQLVirtualization
Data Engineering
Expertise in data pipeline migration, virtualization, and processing using T-SQL and Python. Experience with Azure Data Engineer (DP-203) and Azure Fundamentals (AZ-900) certifications.
Python Development
Proficient in building and distributing company-wide Python libraries, developing data processing jobs, and implementing ETL-tooling for various data analytics projects.
Cloud Technologies
Skilled in working with Azure for data engineering tasks and AWS Lambda for building APIs using Docker and Python.
Data Quality and Analytics
Experience in creating data quality monitoring tools, dashboards, and implementing data quality improvement processes across large-scale systems.
SQL and Database Management
Proficiency in SQL for data manipulation, analysis, and database management, including experience with large datasets and complex queries.
API Development
Capability to design and implement various APIs, including chord recognition and MP3 to MIDI conversion, using modern cloud technologies.
Agile Methodologies
Certified Scrum Master (PSM I) with experience in applying agile principles to data and software development projects.
Expertise in data pipeline migration, virtualization, and processing using T-SQL and Python. Experience with Azure Data Engineer (DP-203) and Azure Fundamentals (AZ-900) certifications.
Python Development
Proficient in building and distributing company-wide Python libraries, developing data processing jobs, and implementing ETL-tooling for various data analytics projects.
Cloud Technologies
Skilled in working with Azure for data engineering tasks and AWS Lambda for building APIs using Docker and Python.
Data Quality and Analytics
Experience in creating data quality monitoring tools, dashboards, and implementing data quality improvement processes across large-scale systems.
SQL and Database Management
Proficiency in SQL for data manipulation, analysis, and database management, including experience with large datasets and complex queries.
API Development
Capability to design and implement various APIs, including chord recognition and MP3 to MIDI conversion, using modern cloud technologies.
Agile Methodologies
Certified Scrum Master (PSM I) with experience in applying agile principles to data and software development projects.
Experience
Professional experience0 - 5 years
Freelancer since2022
Languages
GermanNative speakerEnglishNative speakerDutchNative speaker
Project history
Responsible for migrating data products to a new data virtualisation platform, including building Python libraries and improving data quality processes.
Built APIs in AWS Lambda using Docker and Python, including chord recognition and MP3 to Midi conversion.
Developed data processing jobs with Python for Document Metadata enrichment and implemented AI-tooling for document classification.