03/06/2026 updated
100 % available
Senior Data Engineer with 5+ years experience in scalable data pipelines and warehouses
Dhanbad, India
Worldwide
Master of Computer ApplicationsAbout me
Results-driven Data Engineer with over 5 years of experience designing and managing scalable data pipelines and warehouses using Snowflake, AWS, DBT. Expert in ETL/ELT processes, data modeling, and data governance, with proficiency in Python, SQL, Apache Airflow, and DBT. S
Controles de AccesoAgile MethodologyApache AirflowAmazon Web ServicesAutomationBusiness IntelligenceCloud ComputingComplianceComputer ProgrammingInformation EngineeringData GovernanceData InfrastructureExtract Transform Load (ETL)Data ManagementData Modeling
Data Engineering
Data Pipelines, ETL/ELT processes, Data Warehousing, and Data Modeling with expertise in designing and managing scalable solutions
Cloud Platforms
Snowflake, AWS with proficiency in building enterprise-grade data infrastructure and cloud-based solutions
Programming & Tools
Python, SQL, Apache Airflow, and DBT for data processing and workflow automation
Infrastructure Automation
Terraform and Git for infrastructure as code and version control management
Data Governance
Data Quality frameworks, Compliance management, Snowflake Access Controls, and Collibra for enterprise data governance
Visualization
PowerBI for creating business intelligence dashboards and data visualization
Quality Assurance
Python-based testing strategies and Great Expectations framework for data quality validation
Agile Methodologies
Sprint planning, retrospectives, and stakeholder collaboration for project delivery optimization
Experience
Professional experience5 - 10 years
Freelancer since2021
Languages
EnglishFluent
Project history
Responsible for creating data pipeline using snowflake and matillion.
Designed and launched scalable data pipelines in Snowflake processing 100TB+ daily IoT and supply chain data. Developed star schema data models and implemented enterprise-grade data governance frameworks. Automated ETL/ELT workflows with Python and Airflow, reducing processing time by 25%.
Built robust Snowflake pipelines for 5TB+ daily SIEM logs using Snowpipe and DBT. Designed and optimized data warehouse schemas achieving 99.8% dashboard reliability. Automated ETL/ELT processes migrating 3.7M+ legacy records and implemented data quality frameworks with Great Expectations.