07/12/2026 updated

**** ******** ****
100 % available

Senior Data Engineer & Architect | 6+ Years | Snowflake, dbt, Airflow, SQL, API, Analytics, ETL/ELT

Bengaluru, India
Only remote
BE Computer Science and Data Engineering
Bengaluru, India
Only remote
BE Computer Science and Data Engineering

Profile attachments

Adarsh_Raj_Resume.pdf

About me

A Senior Data Engineer with 6+ years of strong technical expertise in building reliable and scalable data infrastructure, from data ingestion to transformation to warehousing, streaming, and analytics, specializing in dbt, Snowflake, Airflow, Databricks (and more) across AWS, Azure, and GCP.

dbtSql Data WarehouseApache AirflowCloud EngineeringCouchDBData ArchitectureData InfrastructureData MigrationData Transformation ServicesData VirtualizationData WarehousingDatabase DevelopmentPython (Programming Language)PostgreSQLAzure Data LakeDatabase EnginesAzure Data FactorySnowflakeApache SparkApache FlinkGoogle BigqueryAWS Data AnalyticsAzure Service FabricAzure Data AnalyticsData PipelineAirtableAmazon RedshiftDatabricks
I'm a Senior Data Engineer with 6+ years of strong technical expertise in building reliable and scalable data infrastructure, from data ingestion to transformation to warehousing, streaming, and data analytics, specializing in dbt, Snowflake, Airflow, Databricks (and more) across AWS, Azure, and GCP, with robust ELT and ETL pipelines.

I cover the full data engineering lifecycle: batch and real-time data pipelines, Modern Data Stack builds, lakehouse architecture, cloud and warehouse data migration, governance, and the AI data foundations that feed modern systems.

?Core Expertise:
✅ Data Pipelines & Orchestration: End-to-end batch and real-time pipelines with Apache Airflow, Dagster, Prefect, and Azure Data Factory. Idempotent, schema-drift tolerant, and monitored so failures surface before they reach your stakeholders.

✅ Cloud Warehousing & Lakehouse: Snowflake, BigQuery, Amazon Redshift, Databricks, and Microsoft Fabric, with Delta Lake and Apache Iceberg lakehouse foundations, Medallion Architecture, partitioning, and performance tuning.

✅ Data Transformation & Modeling: dbt (Core and Cloud), SQLMesh, Spark and PySpark, Star Schema and dimensional modeling, analytics engineering best practices, full test coverage, and CI/CD for data models.

✅ Streaming & Real-Time Analytics: Distributed streaming with Apache Kafka, Flink, Spark Structured Streaming, Kinesis, and Pub/Sub, including exactly-once semantics, dead-letter queues, CDC, and end-to-end latency guarantees.

✅ Data Ingestion & Integration: Fivetran, Airbyte, Matillion, Stitch, Hevo, Meltano, and custom CDC pipelines for near-real-time sync across structured, semi-structured, and unstructured sources.

✅ Data Quality, Governance & Observability: Automated data quality frameworks, SLA monitoring, auditable lineage, data catalog and metadata management, and observability that catches bad data early.

✅ Cloud Migration & Modernization: Zero-downtime migration handled end to end, from legacy warehouse assessment through cutover, with zero data loss and minimal downtime, replacing brittle ETL and ELT with a clean Modern Data Stack.

------------------------------------------------------

⚙️Tech Stack:
⚡ Warehouses & Lakehouse: Snowflake | BigQuery | Redshift | Databricks | Microsoft Fabric | Delta Lake | Iceberg

⚡ Transformation: dbt | SQLMesh | Spark | PySpark | Star Schema | Medallion Architecture

⚡ Orchestration: Airflow (GCP Cloud Composer and AWS MWAA) | Dagster | Prefect | Azure Data Factory

⚡ Streaming: Kafka | Flink | Kinesis | Pub/Sub | Spark Structured Streaming | ClickHouse

⚡ Ingestion: Fivetran | Airbyte | Matillion | Stitch | Hevo | Meltano | CDC

⚡ Cloud: AWS | GCP | Azure

⚡ Languages: Python | SQL (Snowflake, BigQuery, T-SQL, PL/pgSQL) | FastAPI

⚡ Databases: PostgreSQL | MySQL | SQL Server | DynamoDB | MongoDB

⚡ BI & Reporting: Looker | Tableau | Power BI | GA4 | Metabase | Superset | Streamlit | Grafana

Experience

Professional experience5 - 10 years
Freelancer since2019

Languages

EnglishNative speakerHindiNative speaker

Project history

Senior Data Engineer and Architect


Certificates

Google Analytics

Google

2022

Certified Data Engineer

RapidMiner

2020

Certified Developer

Dataiku

2020


Contact form

Log in to get in touch

You need to be logged in to use the contact form.

Sign upLog in