Description
We have an exciting Job opportunity for Azure Data lake Tech lead role at London, UK.
Job Title: Azure Data lake Tech lead
Location: London, UK
Job Type: Contract
Job Description:
- Looking for domain consultants with hands-on data analytics experience to work on transformative and value driven uses cases like Improving operational efficiency, resource optimization, refinery outputs in Downstream MI/Performance Management area.
- Total 8-10 years of IT experience
- 5+ years of technical analyst, product implementation, system integration or development experience in Data Analytics space using Azure Data lake platform.
- Knowledge on Azure Fundamentals
- Various Tools used in Data Ingestion - Databricks, Azure Data Factory, knowledge on Sqoop, Oozie
- Knowledge on Lambda Architecture, Delta Architecture
- Unstructured Data ingestion using Delta Architecture
- Batch Ingestion and Real Time Ingestion(Spark Streaming) using Delta Architecture
- Data Transformation using PySpark, Azure Databricks, U-SQL
- Knowledge on Hadoop system and Databricks File System
- Hands-on knowledge to use Azure SDK for .NET and Python
- Tune and Debug Azure Cosmos DB Solutions
- Working knowledge of Cosmos DB SQL API
- Working knowledge of Cosmos Gremlin API/scripts
- Advantage - Azure Logic Apps, Azure Function, Azure Kubernetes Service, AzureML
Good knowledge of working in Agile/Scrum methodology using Azure DevOps or Jira