11/10/2026 updated
JM
100 % available
Data Engineer (Azure, Databricks, Microsoft Fabric)
Lisbon, Portugal
Only remote
Master's in Business IntelligenceDelta LakeAzure DevOpsMicrosoft AzureContinuous IntegrationPython (Programming Language)Microsoft Power BISQL DatabasesSQL Server Integration ServicesTransact-SQLAzure Data FactoryMicrosoft FabricPySparkDatabricks
Python & PySpark for Data Engineering
Strong expertise in Python and PySpark for building and maintaining data pipelines, developing Spark notebooks, and processing large-scale datasets within modern data architectures.
Azure Ecosystem & ETL Pipeline Development
Extensive experience designing and monitoring ETL pipelines using Azure services including Azure Data Factory, Data Lake, Synapse, Databricks, and Microsoft Fabric, with deployment across DEV/UAT/PROD environments via CI/CD.
Power BI & Data Visualization
Proficiency in developing comprehensive and insightful dashboards and reports using Power BI, supporting data integration and visualization needs across various business areas.
SQL & T-SQL
Solid command of SQL and T-SQL for data querying, transformation, and integration tasks within data engineering projects.
Databricks & Medallion Lakehouse Architecture
Hands-on experience designing medallion lakehouse architectures, configuring Databricks-to-Fabric mirroring, and managing report migrations from Databricks to Fabric.
Microsoft Fabric
Practical experience leveraging Microsoft Fabric for data integration, pipeline configuration, and report migration within cloud-based real-time data projects.
DevOps & CI/CD
Experience promoting data solutions across DEV/UAT/PROD environments using CI/CD practices within Azure DevOps.
SSIS & Cloud Integration Services
Knowledge of SQL Server Integration Services (SSIS) and cloud integration services, applied in Big Data projects within the banking sector.
SQL Server Management Studio (SSMS) & Tabular Editor
Familiarity with SSMS and Tabular Editor for database management and data modeling tasks in multi-country logistics projects.
Logic Apps & Power Automate
Experience utilizing Azure Logic Apps and Power Automate as part of digital transformation and ETL development initiatives.
Strong expertise in Python and PySpark for building and maintaining data pipelines, developing Spark notebooks, and processing large-scale datasets within modern data architectures.
Azure Ecosystem & ETL Pipeline Development
Extensive experience designing and monitoring ETL pipelines using Azure services including Azure Data Factory, Data Lake, Synapse, Databricks, and Microsoft Fabric, with deployment across DEV/UAT/PROD environments via CI/CD.
Power BI & Data Visualization
Proficiency in developing comprehensive and insightful dashboards and reports using Power BI, supporting data integration and visualization needs across various business areas.
SQL & T-SQL
Solid command of SQL and T-SQL for data querying, transformation, and integration tasks within data engineering projects.
Databricks & Medallion Lakehouse Architecture
Hands-on experience designing medallion lakehouse architectures, configuring Databricks-to-Fabric mirroring, and managing report migrations from Databricks to Fabric.
Microsoft Fabric
Practical experience leveraging Microsoft Fabric for data integration, pipeline configuration, and report migration within cloud-based real-time data projects.
DevOps & CI/CD
Experience promoting data solutions across DEV/UAT/PROD environments using CI/CD practices within Azure DevOps.
SSIS & Cloud Integration Services
Knowledge of SQL Server Integration Services (SSIS) and cloud integration services, applied in Big Data projects within the banking sector.
SQL Server Management Studio (SSMS) & Tabular Editor
Familiarity with SSMS and Tabular Editor for database management and data modeling tasks in multi-country logistics projects.
Logic Apps & Power Automate
Experience utilizing Azure Logic Apps and Power Automate as part of digital transformation and ETL development initiatives.
Experience
Professional experience0 - 5 years
Freelancer since2025
Languages
EnglishFluentPortugueseNative speaker
Project history
Contributing to the OneOT Program, a cloud-based real-time data project built on Azure, Databricks, Data Factory, Microsoft Fabric, and Power BI. Responsibilities include designing medallion lakehouse architectures, developing Spark notebooks, and configuring Databricks-to-Fabric mirroring. Solutions are promoted across DEV/UAT/PROD environments via CI/CD, with ongoing pipeline monitoring. Achievement: Report Migration from Databricks to Fabric.
Supporting the team in developing and enhancing data solutions across various markets using Microsoft technologies including Azure, DevOps, Data Factory, Databricks, SQL Server Management Studio (SSMS), Tabular Editor, and Power BI. Involved in a major migration project transitioning legacy systems to a modern, scalable data architecture.
Worked in Big Data projects in the banking sector using Cloud Azure and Integration Services (SSIS). Responsibilities included ensuring daily ETL process flows, performing new extractions, transformations and integrations in data reports, and implementing automation in projects.