05/12/2026 updated


verified
100 % availableData Engineer | Cloud & Big Data Specialist
Vila Nova de Gaia, Portugal
Worldwide
Undergraduate Computer Science (8th Semester) - University of Sao Paulo (UNIP)GitHub ActionsAzure DatabricksdbtApache AirflowBig DataGoogle BigQueryData InfrastructureExtract Transform Load (ETL)Data WarehousingGitHubPython (Programming Language)KNIMEPostgreSQLPentaho Data IntegrationSQL Databases
Cloud Data Engineering (AWS, GCP, Azure)
Extensive experience designing and implementing scalable data architectures on major cloud platforms including AWS (S3, Lambda, SQS, Glue, Athena), Google Cloud (BigQuery, Cloud Functions, Dataform, Terraform) and Azure (Data Lake, Data Factory, Databricks). Migration of legacy on-premises systems to cloud-native solutions with a focus on cost optimization and resilience.
Databricks & Lakehouse Architecture
Deep expertise in building Lakehouse architectures using Databricks with Bronze/Silver/Gold layers. Experience with both Azure Databricks and AWS-integrated Databricks environments, including PySpark processing, data modeling, and integration with reporting tools such as Power BI and Microsoft Fabric.
ETL/ELT & Data Pipeline Development
Strong background in designing and automating ETL/ELT pipelines using tools such as Pentaho Data Integration, Talend, Snowflake Tasks, Azure Data Factory, and AWS Glue. Proficient in Python and SQL for data extraction, transformation, and loading across diverse data sources including databases, IoT, Kafka, and APIs.
Snowflake
Hands-on experience processing customer data in Snowflake, including ingestion of XML and CSV files via Snowpark and SQL, designing silver layer transformations, creating Stored Procedures, and automating orchestration with Snowflake Tasks.
Python & PySpark
Proficient in Python and PySpark for data engineering tasks including data extraction, transformation, pipeline development, Cloud Functions, Glue jobs, and Snowpark-based ingestion workflows.
Power BI & Data Visualization
Experience creating dashboards, reports, and data models in Power BI, including connecting Power BI to Lakehouse architectures, creating Fabric views, and training business and IT users.
SQL & Database Technologies
Strong SQL skills applied across multiple platforms including SQL Server, Oracle, PostgreSQL, BigQuery, and Snowflake. Experience with T-SQL, Oracle PL/SQL, and query development for data manipulation and reporting.
Tableau
Experience as Tableau Server Administrator and developer, creating dashboards and reports, managing user access and refresh schedules, and connecting Tableau to data sources such as AWS Athena.
Google Cloud Platform (GCP)
Practical experience with GCP services including BigQuery, Google Cloud Storage, Cloud Functions, Dataform, Looker, and Terraform for infrastructure provisioning and management.
Pentaho Data Integration
Extensive use of Pentaho Data Integration (PDI) for ETL process automation, data warehouse generation, orchestration of R model execution, and integration with various data sources including databases, IoT, Kafka, and Cloudera.
Extensive experience designing and implementing scalable data architectures on major cloud platforms including AWS (S3, Lambda, SQS, Glue, Athena), Google Cloud (BigQuery, Cloud Functions, Dataform, Terraform) and Azure (Data Lake, Data Factory, Databricks). Migration of legacy on-premises systems to cloud-native solutions with a focus on cost optimization and resilience.
Databricks & Lakehouse Architecture
Deep expertise in building Lakehouse architectures using Databricks with Bronze/Silver/Gold layers. Experience with both Azure Databricks and AWS-integrated Databricks environments, including PySpark processing, data modeling, and integration with reporting tools such as Power BI and Microsoft Fabric.
ETL/ELT & Data Pipeline Development
Strong background in designing and automating ETL/ELT pipelines using tools such as Pentaho Data Integration, Talend, Snowflake Tasks, Azure Data Factory, and AWS Glue. Proficient in Python and SQL for data extraction, transformation, and loading across diverse data sources including databases, IoT, Kafka, and APIs.
Snowflake
Hands-on experience processing customer data in Snowflake, including ingestion of XML and CSV files via Snowpark and SQL, designing silver layer transformations, creating Stored Procedures, and automating orchestration with Snowflake Tasks.
Python & PySpark
Proficient in Python and PySpark for data engineering tasks including data extraction, transformation, pipeline development, Cloud Functions, Glue jobs, and Snowpark-based ingestion workflows.
Power BI & Data Visualization
Experience creating dashboards, reports, and data models in Power BI, including connecting Power BI to Lakehouse architectures, creating Fabric views, and training business and IT users.
SQL & Database Technologies
Strong SQL skills applied across multiple platforms including SQL Server, Oracle, PostgreSQL, BigQuery, and Snowflake. Experience with T-SQL, Oracle PL/SQL, and query development for data manipulation and reporting.
Tableau
Experience as Tableau Server Administrator and developer, creating dashboards and reports, managing user access and refresh schedules, and connecting Tableau to data sources such as AWS Athena.
Google Cloud Platform (GCP)
Practical experience with GCP services including BigQuery, Google Cloud Storage, Cloud Functions, Dataform, Looker, and Terraform for infrastructure provisioning and management.
Pentaho Data Integration
Extensive use of Pentaho Data Integration (PDI) for ETL process automation, data warehouse generation, orchestration of R model execution, and integration with various data sources including databases, IoT, Kafka, and Cloudera.
Experience
Professional experience5 - 10 years
Freelancer since2022
Languages
EnglishGoodPortugueseNative speakerSpanishFluent
Project history
Data Engineer role at Best Bi Spain. Projects include: migration of legacy Talend + MySQL process to AWS + Databricks for client Berners Ads with event-driven Lambda Orchestrator + SQS architecture and Lakehouse Bronze/Silver/Gold layers; Snowflake project for NTT Data processing XML and CSV data from S3 with Snowpark and SQL, automated with Snowflake Tasks; Azure Databricks BI migration project for NTT Data implementing Lakehouse layers with PySpark, SQL, Microsoft Fabric and Power BI; Automation of R Models using Pentaho Data Integration for a Bank client with Oracle Data Warehouse storage; POS Migration to Google Cloud for Alcampo using Python Cloud Functions, Dataform, BigQuery, Terraform and Looker.
Responsible for data management in the company. Used Pentaho Data Integration for process automation and ETL with data sources including databases, IoT, Kafka, and Cloudera. Generated Data Warehouse in Postgres on Oracle Cloud. Used GitLab for version control and Jenkins for CI/CD. Used Metabase for data analysis and creation of reports and dashboards.
Used Google Storage to create the Data Lake. Used Pentaho and Python for data ingestion into BigQuery with Data Warehouse. Created dashboards in Power BI and Looker Data Studio. Created and defined data models. Provided support for new team members.