Profileimage by Pulkit Jain Azure Data Engineer from Pune

Pulkit Jain

available

Last update: 06.09.2022

Azure Data Engineer

Graduation: Bachelor Of Technology
Hourly-/Daily rates: show
Languages: English (Native or Bilingual)

Attachments

azure-data-engineer-pulkit_jain.pdf

Skills

Pulkit is a Microsoft Certified Azure Data Engineer and Power BI developer with more than six years of experience in Data Engineering and Business Intelligence. He has designed and implemented end-to-end data solutions in Azure. Pulkit is an expert in the Azure suite of products, Azure Data Factory, Synapse, Azure Data Lake, Databricks, SQL servers, SSIS, and Power BI

Project history

12/2020 - Present
Senior Azure Data Engineer
KCSIT (Internet and Information Technology, 5000-10.000 employees)

  • Created 100+ Azure Data Factory pipelines that could extract the data from many diverse sources, transform and load it to different sink destinations, and even refresh the Power BI dashboards upon completion with automated scheduled triggers.
  • Archived more than 5TB of data from multiple applications based on complex business rules to cold storage.
  • Created complex SQL procedures and queries to transform, clean, and process huge data as per the business logic.
  • Created advance reports and real-time dashboards using Microsoft Power BI, Dax, and Power Query.

03/2020 - 10/2020
Azure Data Engineer
Amdocs (Internet and Information Technology, >10.000 employees)

  • Created data audits and data validation to check data integrity.
  • Implemented transformation logic and cleansing logic in Azure Databricks using Spark SQL in SQL context only.
  • Created connections inside Azure Databricks to connect with Azure Blob storage using a secret scope and secret keys.
  • Migrated legacy data workloads for more than 20 complex modules from on-premise integration packages to Azure Data Factory, removed their dependencies from on-premise infrastructure and migrated every intricacy to Azure PaaS.
  • Coordinated with data scientist teams to prepare the data for data science experiments and orchestrated these experiments in Azure Data Factory pipelines in the form of ML Studio Experiment and Databricks notebook.
  • Optimized the degree of parallelism and computing power for the best results in Azure Data Factory Pipelines and used complex for-loops to attain the shortest runtime possible.

11/2015 - 05/2020
Azure Data Engineer
Tata Consultancy Services (Internet and Information Technology, >10.000 employees)

  • Intensively worked in Azure Data Factory, Azure, Blob Storage, Azure SQL Database, Azure Synapse, and Azure Databricks.
  • Used Azure DevOps for versioning and repositories in Azure Data factory. Implemented CI/CD deployment using Azure Resource Management template for Azure Data Factory multi-environment deployment.
  • Successfully extracted data from SSAS cube using Azure Data Factory. Implemented Azure SSIS integration runtime and Azure SQL database catalog to store SIIS packages.
  • Created and configured integration runtimes in different environments with optimized linked services and datasets.

Local Availability

Only available in these countries: India
N/A
Profileimage by Pulkit Jain Azure Data Engineer from Pune Azure Data Engineer
Register