Data Engineer
Contractor, Remote
Keywords
Microsoft Azure
Data Warehousing
Data Analysis
Extract Transform Load (ETL)
Big Data
Data Quality
Machine Learning
Azure Data Factory
Business Intelligence
Cloud Computing
Skills
Azure Data Engineering
Extensive experience with Azure data services including Azure Data Factory, Azure Synapse, and Azure Databricks for building efficient ETL pipelines and data warehouses.
Data Warehousing
Proficient in designing and implementing data warehouses using various technologies such as Azure Synapse and Snowflake, with a focus on data quality and reliability.
ETL Development
Skilled in cloud-based ETL development, optimizing pipelines for data quality and reliability, and integrating data from multiple sources.
Machine Learning & Deep Learning
Knowledge in implementing machine learning models, including wind speed estimation using Azure Data Factory.
Data Science & Analytics
Proficiency in data analysis using SQL, Python, and Power BI for creating impactful dashboards and deriving actionable insights.
Big Data Technologies
Experience with big data technologies including Spark, Kafka, and Azure Data Storage for handling large-scale data processing.
Business Intelligence
Capability to translate data into business insights, improving products, processes, and business outcomes.
Extensive experience with Azure data services including Azure Data Factory, Azure Synapse, and Azure Databricks for building efficient ETL pipelines and data warehouses.
Data Warehousing
Proficient in designing and implementing data warehouses using various technologies such as Azure Synapse and Snowflake, with a focus on data quality and reliability.
ETL Development
Skilled in cloud-based ETL development, optimizing pipelines for data quality and reliability, and integrating data from multiple sources.
Machine Learning & Deep Learning
Knowledge in implementing machine learning models, including wind speed estimation using Azure Data Factory.
Data Science & Analytics
Proficiency in data analysis using SQL, Python, and Power BI for creating impactful dashboards and deriving actionable insights.
Big Data Technologies
Experience with big data technologies including Spark, Kafka, and Azure Data Storage for handling large-scale data processing.
Business Intelligence
Capability to translate data into business insights, improving products, processes, and business outcomes.
Project history
10/2023
-
Present
Developing systems to ingest and process data using Azure Data Factory and Snowflake. Implementing data cleaning and validation processes in Databricks with Delta tables. Designing data warehouses using Azure Synapse.
10/2021
-
10/2023
Data Engineer
Novagrouder, Lisbon, Portugal
Managed a team for on-premise data warehouse development using Python and SQL Server. Designed ETL pipelines and developed data models for streamlined processing and improved usability.
07/2019
-
10/2021
Azure Data Engineer / Data Scientist
Capgemini Engineering, Lisbon, Portugal
Delivered ETL/ELT projects, implemented OCR technology, and worked on various data science initiatives including machine learning models and Azure Cognitive Services applications.
02/2018
-
09/2018
Intern Programmer
Link Consulting, Lisbon, Portugal
Partnered with cross-functional project stakeholders in delivering complex transition from on-premise servers to the cloud, creating a cost plan tailored to each server.
02/2016
-
01/2018
Website Developer
Planning4Life, Lisbon, Portugal
Contributed to developing and maintaining responsive websites using HTML, CSS, JavaScript, and CMS platforms like WordPress. Focused on performance optimization and integrating tools such as Google Analytics.
Local Availability
Open to travel worldwide
