Description
World Leading Global Energy Oil Company has an exciting opportunity for a Senior Spark Developer to lead and deliver Spark development in some of the most complex Data Science and AI projects within the oil and gas industry.
Key Responsibilities
- Provide expertise and guidance in the architectural design and implementation of Spark projects, from Data Engineering using Cloud Storage to Machine Learning/Deep Learning pipelines in Data Science and AI
- Hands on implementation and delivery of globally scalable and supportable Spark workloads to a production grade level of quality in an Agile Devops working environment
- Provide technical leadership and impart Spark knowledge to project team members and others in the Data Science Community
Qualifications
- 5+ years of hands on experience with Apache Spark(Pyspark/SparkR/sparklyr)
PySpark and proficiency in Python is essential.
- Proven experience using Spark in the Databricks Ecosystem
- Deep knowledge in the design and implementation of Distributed File Systems, Data Warehousing and Streaming technologies, including data architecture patterns, using Azure
- Experience in deploying and managing Spark ML models at scale
Preferred Qualifications
- BS in Computer Science or equivalent industry experience
- Experience working in the field of Data Engineering/Data Science/AI
- Contributor to Open Source Projects
This needs combining with a positive attitude and an ability to work within a large, globally dispersed project team in a multi-cultural environment. You also need to be a self-starter, a logical thinker and a quick learner, with strong initiative and excellent communication, interpersonal and presentation skills, able to write clearly and concisely.
We believe in equality of opportunity for all job applicants regardless of gender, marital status, race, colour, nationality, ethnic origin, creed or religion, disability, sexual orientation or age.
Specialising within Energy Trading, Oil & Gas, Financial Markets and TV & Entertainment, Eaglecliff Recruitment is ISO accredited, a Member of REC and listed within the top 4% for Financial stability by Dun & Bradstreet. Please telephone for an immediate response or email your CV for a reply within one hour. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.