11/09/2026 updated
100 % available
Lead Data Engineer | Enterprise Data Architect | Snowflake & Databricks Specialist
Bangalore, India
Worldwide
Master of Technology (M.Tech) in Software Systems, BITS Pilani, 2015About me
AI & Data Architect with 17 years of IT experience, specializing in Snowflake, multi-cloud architecture, Data Engineering, and GenAI. Expert in large-scale migrations, ETL/ELT pipelines, Databricks, Azure, AWS, GCP, data modelling, enterprise architecture, and technical leadership
AI AgentsRAGLLMGCPAzure Data FactorySnowflakeAWS GlueDatabricks
Snowflake & Cloud Data Architecture
Extensive expertise in designing and implementing large-scale Snowflake ecosystems, including end-to-end migration strategies from legacy Hadoop platforms, hybrid cloud solutions, and enterprise data warehouse administration across multiple industries.
Data Engineering & ETL/ELT Pipelines
Deep proficiency in building and orchestrating sophisticated data pipelines using Apache Spark, PySpark, dbt, Informatica, AWS Glue, Azure Data Factory, Apache Airflow, and Apache NiFi to enable reliable and scalable data flows.
AI & Advanced Analytics Integration
Strong background in bridging traditional data engineering with cutting-edge AI technologies, including Gen AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and Predictive Modelling to transform complex data into actionable business intelligence.
Multi-Cloud Strategy (Azure, AWS, GCP)
Proven experience architecting and executing multi-cloud strategies across Azure, AWS, and GCP, including serverless architectures and TOGAF-aligned enterprise architecture frameworks.
Databricks & Big Data Platforms
Hands-on experience with Databricks, Hadoop, Azure Synapse, Amazon Redshift, Oracle, and Vertica for large-scale data processing and analytics workloads.
BI & Data Visualisation
Skilled in delivering business intelligence solutions using Tableau, Power BI (Fabrics), Tableau CRM (Einstein Analytics), and OBIEE, including migrating complex analytics dashboards between platforms.
Orchestration & DevOps
Proficiency in workflow orchestration and DevOps practices using Apache Airflow, Apache NiFi, Git, Azure DevOps, and CI/CD pipelines to ensure reliable and automated delivery of data solutions.
Data Modelling & Architecture Design
Expertise in High-Level Design (HLD) and Low-Level Design (LLD) for modern data platforms, including data modelling, stored procedures, and materialised views across cloud and on-premise environments.
Agile Project & Team Leadership
Demonstrated ability to lead cross-functional global engineering teams, manage agile sprint planning, and oversee large-scale migration milestones with 100% on-time delivery.
Extensive expertise in designing and implementing large-scale Snowflake ecosystems, including end-to-end migration strategies from legacy Hadoop platforms, hybrid cloud solutions, and enterprise data warehouse administration across multiple industries.
Data Engineering & ETL/ELT Pipelines
Deep proficiency in building and orchestrating sophisticated data pipelines using Apache Spark, PySpark, dbt, Informatica, AWS Glue, Azure Data Factory, Apache Airflow, and Apache NiFi to enable reliable and scalable data flows.
AI & Advanced Analytics Integration
Strong background in bridging traditional data engineering with cutting-edge AI technologies, including Gen AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and Predictive Modelling to transform complex data into actionable business intelligence.
Multi-Cloud Strategy (Azure, AWS, GCP)
Proven experience architecting and executing multi-cloud strategies across Azure, AWS, and GCP, including serverless architectures and TOGAF-aligned enterprise architecture frameworks.
Databricks & Big Data Platforms
Hands-on experience with Databricks, Hadoop, Azure Synapse, Amazon Redshift, Oracle, and Vertica for large-scale data processing and analytics workloads.
BI & Data Visualisation
Skilled in delivering business intelligence solutions using Tableau, Power BI (Fabrics), Tableau CRM (Einstein Analytics), and OBIEE, including migrating complex analytics dashboards between platforms.
Orchestration & DevOps
Proficiency in workflow orchestration and DevOps practices using Apache Airflow, Apache NiFi, Git, Azure DevOps, and CI/CD pipelines to ensure reliable and automated delivery of data solutions.
Data Modelling & Architecture Design
Expertise in High-Level Design (HLD) and Low-Level Design (LLD) for modern data platforms, including data modelling, stored procedures, and materialised views across cloud and on-premise environments.
Agile Project & Team Leadership
Demonstrated ability to lead cross-functional global engineering teams, manage agile sprint planning, and oversee large-scale migration milestones with 100% on-time delivery.
Experience
Professional experience10+ years
Freelancer since2012
Languages
EnglishNative speaker
Project history
Directed end-to-end migration strategy and architecture design to transition a massive-scale legacy Hadoop platform (Apache Luigi, Spark, Torque) to a modernised Snowflake ecosystem. Spearheaded MVP development alongside Snowflake SMEs and client engineering teams. Architected robust data pipelines for enterprise data feeding into Analytics and AI/ML models. Led agile sprint planning and managed cross-functional engineering pods ensuring 100% on-time delivery. Key Client: Comscore - Market Research.
Orchestrated a large-scale on-premise to cloud data migration leveraging Informatica PowerCenter and dbt to centralise enterprise data within Snowflake. Led the strategic migration of Business Intelligence infrastructure, transitioning complex analytics dashboards from Tableau to Microsoft Power BI (Fabrics). Key Client: Wolfspeed & Cree.
Designed HLD and LLD architectures for a modern hospitality data platform (MDP), migrating critical workloads from legacy systems. Built and orchestrated sophisticated data pipelines utilising Snowflake, dbt, Apache Airflow, Apache NiFi, and AWS S3. Automated external-to-internal S3 bucket file transfers using NiFi and authored complex Airflow DAGs and Snowflake Stored Procedures. Managed production deployments, QA processes, and agile scrum lifecycles. Key Clients: Marriott International, Air Products, Vulcan Materials.