Description
The Data Engineer plays a key role in the development and deployment of innovative Azure based data platforms for analytics and data processing.
Job Description
• The Data Engineer is an expert in developing Azure Datafactory pipelines, Azure Databricks (Python/SQL) notebooks, and Databricks Delta Lake.
• Good knowledge in using Azure Datalake, GIT hub, DevOps, and Azure Resources(Resource group, KeyValult etc..)
• SQL Server DB (Good knowledge in writing store procedures, views, optimisation etc)
• Should have good background in ETL/ELT and Data Space with clear concept of data lakes
• Solid experience in developing complex data pipelines in the above tech stack
• Solid appreciation of data for business usage
• Good Communication & Documentation Skills
• It would be nice to have experience in Kafka/Confluent, Azure API management and MS PowerApps, CI/CD implementation
Primary Skills:
AZURE Data Factory
AXURE Data Bricks
Python SQL
Secondary Skills:
GIT Hub
SQL Server Databases