10/20/2025 updated
100 % available
Senior Data Engineer
Catania, Italy
Only remote
Bachelor's degree in Computer ScienceAbout me
Passionate, creative, and sociable Data Engineer with ~6 years of experience in Data Engineering, specializing in the Mar-tech and Telecom industries. Big Data developer focused on bridging the gap between technology and business.
Apache AirflowAmazon Web ServicesAutomationTest AutomationMicrosoft AzureBig DataCloud ComputingComputer ProgrammingDatabasesContinuous IntegrationInformation EngineeringData InfrastructureExtract Transform Load (ETL)Data ManagementData Quality
Apache Spark
Advanced expertise in Apache Spark for big data processing and analytics, including PySpark implementation and optimization of data pipelines handling 2TB of data per day
Cloud Computing
Comprehensive experience with Amazon AWS and Microsoft Azure cloud platforms for scalable data infrastructure and ETL pipeline development
Python Programming
Proficient Python development skills for data engineering applications, testing frameworks, and automation solutions
Apache Airflow
Implementation and maintenance of workflow orchestration and scheduling systems for data pipeline automation
Hadoop Ecosystem
Experience with Hadoop, HDFS, Hbase, and related big data technologies for distributed data processing
Database Technologies
Expertise in SQL, MySQL, PostgreSQL for data management and query optimization
Scala Programming
Development experience in Scala for Apache Spark applications and functional programming paradigms
CI/CD and DevOps
Implementation of continuous integration and deployment pipelines using Jenkins, GitHub Actions, and automated testing frameworks
Data Quality and Testing
Design and implementation of automation testing suites using TestNG, Selenium, and Rest-Assured for quality assurance
Advanced expertise in Apache Spark for big data processing and analytics, including PySpark implementation and optimization of data pipelines handling 2TB of data per day
Cloud Computing
Comprehensive experience with Amazon AWS and Microsoft Azure cloud platforms for scalable data infrastructure and ETL pipeline development
Python Programming
Proficient Python development skills for data engineering applications, testing frameworks, and automation solutions
Apache Airflow
Implementation and maintenance of workflow orchestration and scheduling systems for data pipeline automation
Hadoop Ecosystem
Experience with Hadoop, HDFS, Hbase, and related big data technologies for distributed data processing
Database Technologies
Expertise in SQL, MySQL, PostgreSQL for data management and query optimization
Scala Programming
Development experience in Scala for Apache Spark applications and functional programming paradigms
CI/CD and DevOps
Implementation of continuous integration and deployment pipelines using Jenkins, GitHub Actions, and automated testing frameworks
Data Quality and Testing
Design and implementation of automation testing suites using TestNG, Selenium, and Rest-Assured for quality assurance
Experience
Professional experience5 - 10 years
Freelancer since2024
Languages
EnglishFluentItalianNative speaker
Project history
Contributed to major company-wide restructuring project focusing on migration and redesign of critical data infrastructure components. Designed new scheduling architecture to migrate data products from legacy orchestration tool to Apache Airflow and built CI/CD pipelines.
Worked in the Metrics Squad delivering reliable network performance metrics for telecommunications customers. Developed scalable, high-quality pipelines ensuring accurate, replicable, and easily discoverable metrics for Analysts, Data Scientists, and business stakeholders.
Responsible for developing the main company product, the Data Management Platform, a technology for advertisers, broadcasters, and online audience monetization. Worked on on-premise cluster using Hadoop, Apache Spark, MySQL, Microsoft Azure, and other technologies.