12/06/2025 updated
MK
100 % available
Senior Data Engineer
Manchester, England, United Kingdom, USA
Only remote
Bachelor's Degree in Computer and Systems SciencesAbout me
Senior Data Engineer with 8+ years of experience designing, modernizing, and optimizing large- scale data platforms. Specialized in building reliable Python-based services, scalable data architectures, and high-performance pipelines across Cloud, Snowflake, and modern orchestration frameworks.
Apache AirflowAmazon Web ServicesAmazon Elastic Compute CloudAmazon S3Data AnalysisCloud ComputingComputer ProgrammingContinuous IntegrationData As A ServicesData ArchitectureInformation EngineeringExtract Transform Load (ETL)Data TransformationData QualityData Vault Modeling
Cloud Data Engineering
Advanced expertise in designing and implementing scalable data architectures using AWS services including S3, Lambda, Glue, EC2, and Step Functions, combined with Snowflake for data warehousing and cost optimization
Programming and Data Processing
Advanced proficiency in Python and SQL for building high-performance data pipelines, ETL/ELT processes, and PySpark for large-scale data transformation and processing
Data Architecture and Orchestration
Expertise in designing dimensional models, data vault architectures, lakehouse designs, and implementing workflow management using Airflow for DAG design, performance tuning, and scalability
DevOps and Infrastructure
Proficiency in containerization with Docker, orchestration with Kubernetes, infrastructure as code with Terraform, and CI/CD pipeline implementation using GitHub Actions
Analytics and Data Quality
Experience with Pandas, NumPy for data analysis, time-series processing, feature engineering, and implementing data quality frameworks using Great Expectations
Real-time Data Processing
Expertise in event-driven architecture, real-time data ingestion using Kafka, and streaming data processing for operational insights
Monitoring and Observability
Implementation of observability and monitoring solutions using CloudWatch and Grafana for system reliability and performance tracking
API Development
Experience in API development for data services and integration with various data sources and systems
Advanced expertise in designing and implementing scalable data architectures using AWS services including S3, Lambda, Glue, EC2, and Step Functions, combined with Snowflake for data warehousing and cost optimization
Programming and Data Processing
Advanced proficiency in Python and SQL for building high-performance data pipelines, ETL/ELT processes, and PySpark for large-scale data transformation and processing
Data Architecture and Orchestration
Expertise in designing dimensional models, data vault architectures, lakehouse designs, and implementing workflow management using Airflow for DAG design, performance tuning, and scalability
DevOps and Infrastructure
Proficiency in containerization with Docker, orchestration with Kubernetes, infrastructure as code with Terraform, and CI/CD pipeline implementation using GitHub Actions
Analytics and Data Quality
Experience with Pandas, NumPy for data analysis, time-series processing, feature engineering, and implementing data quality frameworks using Great Expectations
Real-time Data Processing
Expertise in event-driven architecture, real-time data ingestion using Kafka, and streaming data processing for operational insights
Monitoring and Observability
Implementation of observability and monitoring solutions using CloudWatch and Grafana for system reliability and performance tracking
API Development
Experience in API development for data services and integration with various data sources and systems
Experience
Professional experience5 - 10 years
Freelancer since2025
Languages
EnglishFluent
Project history
Designed and implemented multi-country ETL/ELT pipelines integrating transactional, behavioral, and operational data while ensuring compliance with GDPR and US privacy laws. Led modernization of data workflows, replacing legacy components with scalable AWS and Snowflake-aligned architectures.
Engineered a healthcare analytics platform processing patient engagement, appointment behavior, and care-cycle data across multiple clinics. Built AWS Glue ETL pipelines and developed PySpark jobs for time-series datasets enabling patient volume forecasting and clinic utilization metrics.
Started as a business/data analyst and transitioned into data engineering by automating reporting pipelines and centralizing analytics workflows. Consolidated finance, product, and operational datasets into structured schemas using PostgreSQL and MySQL.