06/18/2026 updated
100 % available
Data Engineer | ETL Pipelines | Cloud Data Warehousing | BI Dashboards
Sharqia, Egypt
Only remote
Bachelor of Commerce (English Section) - Accounting Major, Banha University, Egypt (2021-2025)About me
Data Engineer with hands-on experience building end-to-end pipelines and analytics platforms. Built GlowPipe (Lambda Architecture) using Airflow, PySpark, Kafka, and Snowflake, and an EPL data warehouse in Snowflake with Power BI dashboards. AWS-trained in Cloud Foundations and Data Engineering.
ETL/ELT Pipeline Development
Hands-on experience designing and implementing end-to-end ETL and ELT pipelines using Python, Apache Airflow, PySpark, and Kafka, including Medallion Architecture (Bronze, Silver, Gold) with Snowflake as the central data warehouse.
Cloud Data Warehousing & Data Modeling
Practical knowledge in building cloud-based data warehouses on Snowflake and AWS S3, applying dimensional data modeling, Star Schema design, and scalable analytical data solutions.
Big Data & Stream Processing
Experience with Apache Spark (PySpark, Structured Streaming) and Apache Kafka for real-time streaming pipelines, live event processing, and large-scale batch data processing.
Business Intelligence & Data Visualization
Creation of BI dashboards using Power BI and DAX for historical analytics and business insights, as well as data visualizations with Pandas, NumPy, Matplotlib, and Seaborn.
Programming Languages
Proficiency in Python, SQL, PySpark, and Bash for data engineering tasks, pipeline development, data transformation, and automation.
Databases
Working knowledge of relational and non-relational databases including SQL Server, PostgreSQL, and MongoDB for data storage and querying.
DevOps & Version Control Tools
Familiarity with Docker for containerization and Git/GitHub for version control and collaborative development workflows.
REST API Data Extraction
Development of Python pipelines to extract and transform REST API JSON data into tabular datasets, including data cleaning, preprocessing, and validation using Pandas and NumPy.
Cloud Platforms & Certifications
Certified in Cloud Data Engineering and Cloud Foundations by Amazon Web Services (AWS), and Big Data with Spark and Hadoop Essentials by IBM, with practical experience on AWS S3 and Snowflake Cloud.
Hands-on experience designing and implementing end-to-end ETL and ELT pipelines using Python, Apache Airflow, PySpark, and Kafka, including Medallion Architecture (Bronze, Silver, Gold) with Snowflake as the central data warehouse.
Cloud Data Warehousing & Data Modeling
Practical knowledge in building cloud-based data warehouses on Snowflake and AWS S3, applying dimensional data modeling, Star Schema design, and scalable analytical data solutions.
Big Data & Stream Processing
Experience with Apache Spark (PySpark, Structured Streaming) and Apache Kafka for real-time streaming pipelines, live event processing, and large-scale batch data processing.
Business Intelligence & Data Visualization
Creation of BI dashboards using Power BI and DAX for historical analytics and business insights, as well as data visualizations with Pandas, NumPy, Matplotlib, and Seaborn.
Programming Languages
Proficiency in Python, SQL, PySpark, and Bash for data engineering tasks, pipeline development, data transformation, and automation.
Databases
Working knowledge of relational and non-relational databases including SQL Server, PostgreSQL, and MongoDB for data storage and querying.
DevOps & Version Control Tools
Familiarity with Docker for containerization and Git/GitHub for version control and collaborative development workflows.
REST API Data Extraction
Development of Python pipelines to extract and transform REST API JSON data into tabular datasets, including data cleaning, preprocessing, and validation using Pandas and NumPy.
Cloud Platforms & Certifications
Certified in Cloud Data Engineering and Cloud Foundations by Amazon Web Services (AWS), and Big Data with Spark and Hadoop Essentials by IBM, with practical experience on AWS S3 and Snowflake Cloud.
Languages
EnglishGood
Project history
Trained in building end-to-end data pipelines, data warehousing, and workflow orchestration using Python, SQL, Spark, Airflow, Snowflake, and Kafka. Applied data modeling, ETL processes, and cloud storage concepts to develop scalable analytical data solutions.
Built a batch ETL pipeline using Apache Airflow and PySpark implementing Medallion Architecture (Bronze, Silver, Gold) with Snowflake as the central data warehouse. Extended with a real-time streaming layer via Apache Kafka and Spark Structured Streaming for live event processing, allergen outbreak detection, and trending product monitoring. Delivered insights through Power BI dashboards and Grafana. Technologies: Python, PySpark, Apache Airflow, AWS S3, Snowflake, Power BI, Apache Kafka, Spark Structured Streaming, PostgreSQL, Grafana, Streamlit.
Built a Python ETL pipeline to load 12,000+ football records from CSV files into Snowflake. Designed a Star Schema with fact and dimension tables to support analytical queries. Implemented Bronze, Silver, and Gold layers using Medallion Architecture. Technologies: Python, Snowflake, Power BI, DAX, Medallion Architecture.