08/10/2026 updated
100 % available
Data Engineer | Microsoft Fabric Specialist
surat, India
Only remote
B.Tech in Information TechnologyAbout me
Microsoft Fabric Specialist || Data Engineer || Microsoft Certified: Power BI Data Analyst Associate || Microsoft Certified: Fabric Data Engineer Associate
Data ModelingData WarehousingPython (Programming Language)Microsoft Power BISQL DatabasesMicrosoft FabricPySpark
Microsoft Fabric & Data Platform Engineering
Expertise in Microsoft Fabric covering Lakehouses, Data Pipelines, Notebooks, Dataflows Gen2, Warehouse, OneLake, Fabric Capacity, and Real-Time Analytics. Design and implementation of end-to-end data solutions including Medallion Architecture (Bronze, Silver, Gold) using Delta Lake tables with incremental processing and schema evolution.
ETL / Integration & PySpark Development
Proficiency in building distributed ETL pipelines using PySpark, Apache Spark, Spark SQL, and Delta Tables. Development of reusable PySpark transformation frameworks for data cleansing, validation, deduplication, surrogate key generation, and Slowly Changing Dimension (SCD) processing. Experience with Azure Data Factory (ADF), SSIS, Python ETL Pipelines, Incremental Load, and REST API Ingestion.
Power BI & Business Intelligence Reporting
Advanced skills in Power BI Desktop and Service, including DAX, Power Query (M), Semantic Models, Row-Level Security, Paginated Reports, and Deployment Pipelines. Development of production-grade Power BI semantic models with optimised DAX measures, row-level security, and incremental refresh delivering sub-2-second report load times across 5M+ row datasets.
Cloud & Storage Technologies
Hands-on experience with Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure Blob Storage, Delta Lake, and Snowflake for scalable cloud-first data platform solutions.
Databases & SQL Optimization
Strong background in SQL Server, Azure SQL Database, T-SQL, Stored Procedures, Indexing, Query Optimisation, and Star/Snowflake Schema design. Optimisation of T-SQL stored procedures, indexes, and execution plans reducing average query runtime by 35% on high-volume reporting databases.
DevOps & Governance
Setup and management of Azure DevOps CI/CD pipelines for automated deployment of Fabric artifacts, ADF pipelines, and SQL objects across Dev, UAT, and Prod environments. Familiarity with Git, JIRA, and Agile/Scrum methodologies.
Python & Scripting
Authoring of Python (Pandas/PySpark) scripts for complex data cleansing, validation, and API-based ingestion workflows integrated into Fabric Notebooks.
Data Modeling & Architecture
Experience in data modeling, SQL optimization, and end-to-end data engineering within Agile environments. Design of Medallion Architecture and migration of enterprise on-premises Data Warehouse solutions to modern cloud-based analytics platforms.
Expertise in Microsoft Fabric covering Lakehouses, Data Pipelines, Notebooks, Dataflows Gen2, Warehouse, OneLake, Fabric Capacity, and Real-Time Analytics. Design and implementation of end-to-end data solutions including Medallion Architecture (Bronze, Silver, Gold) using Delta Lake tables with incremental processing and schema evolution.
ETL / Integration & PySpark Development
Proficiency in building distributed ETL pipelines using PySpark, Apache Spark, Spark SQL, and Delta Tables. Development of reusable PySpark transformation frameworks for data cleansing, validation, deduplication, surrogate key generation, and Slowly Changing Dimension (SCD) processing. Experience with Azure Data Factory (ADF), SSIS, Python ETL Pipelines, Incremental Load, and REST API Ingestion.
Power BI & Business Intelligence Reporting
Advanced skills in Power BI Desktop and Service, including DAX, Power Query (M), Semantic Models, Row-Level Security, Paginated Reports, and Deployment Pipelines. Development of production-grade Power BI semantic models with optimised DAX measures, row-level security, and incremental refresh delivering sub-2-second report load times across 5M+ row datasets.
Cloud & Storage Technologies
Hands-on experience with Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure Blob Storage, Delta Lake, and Snowflake for scalable cloud-first data platform solutions.
Databases & SQL Optimization
Strong background in SQL Server, Azure SQL Database, T-SQL, Stored Procedures, Indexing, Query Optimisation, and Star/Snowflake Schema design. Optimisation of T-SQL stored procedures, indexes, and execution plans reducing average query runtime by 35% on high-volume reporting databases.
DevOps & Governance
Setup and management of Azure DevOps CI/CD pipelines for automated deployment of Fabric artifacts, ADF pipelines, and SQL objects across Dev, UAT, and Prod environments. Familiarity with Git, JIRA, and Agile/Scrum methodologies.
Python & Scripting
Authoring of Python (Pandas/PySpark) scripts for complex data cleansing, validation, and API-based ingestion workflows integrated into Fabric Notebooks.
Data Modeling & Architecture
Experience in data modeling, SQL optimization, and end-to-end data engineering within Agile environments. Design of Medallion Architecture and migration of enterprise on-premises Data Warehouse solutions to modern cloud-based analytics platforms.
Experience
Professional experience5 - 10 years
Freelancer since2024
Languages
EnglishFluent
Project history
Migrated enterprise on-premises Data Warehouse solutions to Microsoft Fabric Data Warehouse leveraging Fabric Data Factory, Lakehouse, and Power BI Semantic Models. Designed and implemented a Medallion Architecture within Fabric Lakehouse to process eCommerce sales, customer, inventory, and product data. Developed Fabric Data Factory pipelines for automated ingestion from SQL Server, Azure Blob Storage, and flat files. Designed scalable PySpark notebooks for cleansing, transforming, enriching, and aggregating millions of transactional records. Created and optimized Power BI Semantic Models with advanced DAX measures, incremental refresh, and row-level security. Technologies: Microsoft Fabric, Azure Data Factory, SQL Server, Power BI, PySpark.
Developed an enterprise-wide sales and customer analytics solution using SQL Server and Power BI supporting reporting requirements across Sales, Marketing, Operations, and Finance teams. Designed and optimized complex T-SQL stored procedures, views, and ETL processes to consolidate data from ERP, CRM, eCommerce, and inventory management systems. Created advanced Power BI Semantic Models with optimized relationships, aggregation tables, calculation groups, and incremental refresh. Developed 20+ interactive Power BI dashboards and reports tracking revenue, profitability, customer acquisition, retention, product performance, inventory levels, and regional sales trends. Technologies: Power BI, SQL Server, T-SQL, SSIS, Microsoft Fabric, DAX, Power Query.
Architected end-to-end data solutions on Microsoft Fabric including Lakehouses, Data Pipelines, and PySpark Notebooks for large-scale transformation. Implemented Bronze, Silver, and Gold Medallion Architecture using Delta Lake tables. Migrated legacy ADF pipelines to Fabric Data Pipelines and Dataflows Gen2, reducing pipeline maintenance overhead by ~40%. Developed production-grade Power BI semantic models with optimised DAX measures and row-level security. Migrated enterprise on-premises Data Warehouse solutions to Microsoft Fabric Data Warehouse. Designed and optimised T-SQL stored procedures and views in Azure SQL Database and Fabric Warehouse. Set up Azure DevOps CI/CD pipelines for automated deployment across Dev/UAT/Prod environments.