Python Databricks Software Engineer

Vienna, Vienna  ‐ Hybrid

Keywords

Databricks Cloud Computing Github Python (Programming Language) Software Engineering Data Streaming Apache Kafka Amazon Web Services Amazon S3 Banking Services Code Review Continuous Integration Information Engineering Extract Transform Load (ETL) Software Design Patterns Linux Apache Hadoop Message Broker Online Analytical Processing NoSQL Pair Programming SQL Databases Apache Spark AWS Lambda Pyspark Spark Streaming Code Refactoring Artifactory

Description

Greetings Everyone!

We at #CosMicIT GmbH are urgently looking for #Python Databricks Software Engineer

Proficiency in English is mandatory; German is a plus
Location: Vienna (75% remote)
Start: 15.12.2023 End: 31.12.2024 (may be extended)

Position Summary:
Activities:
• Develop, optimize, and operate data processing pipelines using Python-based landscape (PySpark), including streaming data processing technologies (Kafka and Spark Streaming)
• Design and improve cloud-based solutions and interlink them with on-premise environments
• Work out jointly with teammates on the architectural aspects of a solution design
• Implementation of software development best practices and development standards into a development process within the team
• Support and mentoring of our teammates regarding the software development

Requirements:
• Minimum of 2 years practical experience of development on Databricks
• Hands-on experience with Apache Spark (RDD, dataframes, streaming)
• SQL knowledge at the level of development and optimization of complex analytical queries
• Experience of working with message broker technologies: Kafka, Rabbit MQ, Active MQ, or similar
• Practical experience with setting up and configuration of CI/CD pipelines, e.g. Github, Github actions, Artifactory, or similar
• Readiness to mentor less experienced colleagues in code development: pair programming within the team, code review, sharing of software design patterns, joint refactoring, etc

Nice to have:
• Experience of participation in the role of software developer on data engineering projects: streaming data processing, batch processing & ETL/ELT, pipelines orchestration, Hadoop, NoSQL, DWH, OLAP, etc.
• Hands-on experience with cloud computing with AWS, e.g. EC2/AWS based Linux, S3, AWS Lambda, etc
• Understanding of the most common products in the banking area

If any of these openings sound familiar to you or any of your known networks, please share the resume/CV to

Any references would also be accepted.

Thanks & Regards,
CosMicIT GmbH, Germany
CosMicIT Informatics India Pvt Ltd.
CosMicIT Spolka Z Ograniczona Odpowiedzialnoscia, Poland
www.CosMic-IT.com| www.CosMic-IT.in
https://www.linkedin.com/company/cosmic-it

For more job openings for Europe/India please click the given link: https://jobs.cosmic-it.in
Start date
2023
Duration
12 months
(extension possible)
From
CosMicIT GmbH
Published at
08.11.2023
Contact person:
Mritunjay jha
Project ID:
2678228
Industry
IT
Contract type
Freelance
Workplace
80 % remote
To apply to this project you must log in.
Register