Databricks Data Engineer
Amass Technology
Contact person: Charlee Yearwood
Budapest , Hungary
ITDatabase DevelopmentDataOpsDatabase EnginesAWS Data AnalyticsAzure Data AnalyticsDatabricksApache Storm
Description
Amass Technology are looking for a Databricks Data Engineer to join a leading project on a fully remote basis with very occasional travel to project location in central Europe.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and Databricks.
- Develop and support real-time and streaming data solutions.
- Work with technologies including Azure Event Hub, Kafka, Apache Druid, and Apache Storm.
- Support the development and migration of existing data pipelines and platforms.
- Build and optimise cloud-based data solutions within the Microsoft Azure ecosystem.
- Analyse existing solutions and legacy code to support modernisation and migration activities.
- Collaborate with cross-functional teams within an Agile/Scrum environment.
- Apply best practices across CI/CD, DevOps, and DataOps to improve the reliability and efficiency of data engineering processes.
Essential Skills & Experience
- Proven professional experience as a Data Engineer.
- Strong hands-on experience with Databricks and Python.
- Experience with streaming technologies such as Azure Event Hub and Kafka.
- Practical experience with real-time data processing technologies, ideally Apache Druid and/or Apache Storm.
- Experience developing, maintaining, and migrating data pipelines.
- Strong knowledge of cloud-based data platforms, preferably Microsoft Azure.
- Strong problem-solving and analytical skills.
- Ability to work effectively within an agile, collaborative team environment.