Databricks Architect

Darwin is a Specialist Talent Delivery Partner for Databricks Projects. Over the past 6 Years we have supported some of the largest Databricks programs around the Globe.

We are currently seeking a highly skilled Freelance Databricks Architect with deep expertise in designing and implementing data solutions on Azure Databricks to join our customer in the US.

The ideal candidate will have a strong background as both a Databricks Engineer and Architect, capable of leading complex projects and providing strategic guidance on Databricks implementations.

Responsibilities:

• Design, architect, and implement scalable data solutions using Azure Databricks.
• Lead and mentor a team of data engineers in Databricks best practices and methodologies.
• Collaborate closely with stakeholders to gather requirements, define technical specifications, and deliver solutions that meet business needs.
• Optimize and tune Databricks clusters and jobs for performance and reliability.
• Implement data governance and security measures within Databricks environments.
• Develop and maintain ETL processes and data pipelines using Azure Data Factory, Apache Spark, and other relevant technologies.
• Provide technical leadership and guidance on Databricks architecture and best practices.
• Troubleshoot and resolve issues related to Databricks infrastructure and data pipelines.

Duration: 12 Months (Open to an extension)

Location: Remote

Darwin Recruitment is acting as an Employment Business in relation to this vacancy.