Description
Must have experience of:
- Azure Databricks (including Delta Lake) batch or streaming, using Kafka on Cloud
- Azure Data Factory
- Spark
- Kafka (batch or streaming using Kafka on Cloud - Azure is a distinct advantage)
- Containers and container orchestration using Docker, Kubernetes and Helm
- CI/CD including tools such as Maven, Gradle, Jenkins, TeamCity, Gitlabs pipelines
- Experience of building data pipelines
- Azure DevOps pipelines
- Investment Banking domain knowledge (Financing would be a distinct advantage)
Good to have:
- Java, including Spring
- Scala