04/30/2026 updated
100 % available
Azure DataEngineer and Databricks Engineer
Kanpur, India
Only remote
BtechAbout me
Lead Data Engineer and founding member of an early-stage stealth startup building a Databricks-native platform for entity resolution, MDM, and data quality. Deep experience shipping scalable Lakehouse and cloud data solutions — improving processing efficiency by 25%
Microsoft AzureAzure Data LakeAzure Data FactoryPySparkAzure Synapse AnalyticsDatabricks
I'm an experienced Data Engineer with a strong background in implementing scalable data solutions using Microsoft Azure. You’ve led and contributed to projects with significant impact, optimizing data pipelines, enabling real-time data processing, and driving automation. You are results-oriented, with a track record of improving operational efficiency and enhancing data accessibility.
Key Skills
- Cloud Platforms: Microsoft Azure, including Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure Functions, Azure Data Lake Storage (Gen2), Microsoft Fabric
- Programming & Scripting: Python, PySpark, PowerShell
- Data Tools & Platforms: Kafka, SQL Server, Snowflake, Power BI
- DevOps & Automation: Azure DevOps, GitHub Actions, Logic Apps
- Data Engineering Techniques: ETL/ELT pipelines, real-time data ingestion, data validation and cleansing, query optimization, partitioning strategies
- Reporting & Visualization: Power BI dashboards, dataset automation, emailing reports using custom frameworks
Languages
EnglishNative speaker