Description
BigData Engineer - 3 months - Bristol
Financial services client is looking for an experienced BigData Engineer with strong Scala and Spark development skills. You will design and develop data solutions, to be deployed to internal Hadoop cluster (Hortonworks Data Platform).
This is a hands on role, in which you will deliver code to a high standard, whilst mentoring less experienced developers within a feature team and reviewing their work.
You will contribute to the overall technical direction of the team in combination with your effective leadership, communication and stakeholder management skills.
Skills/Experience:
- Computer Science or Software Engineering degree or equivalent experience
- Experience developing applications in Scala, with a keen interest in functional programming principles (experienced Java developers may also be considered)
- Committed to rigorous testing using frameworks such as ScalaTest
- Experience using the Apache Spark data processing framework
- Familiarity with Continuous Integration tools such as Maven, SBT, Jenkins, GIT, Nexus, UrbanCode
- Experience working with the Hadoop framework, and an understanding of the common modules and their inner workings (eg HDFS, Yarn, Hive, HBase and Kafka)
- Demonstrable experience on big data or advanced analytics projects
- Strong SQL, ideally with both relational and dimensional Datamodelling experience.
- Ensure that communication to the business is professional, clear and appropriate
- A good understanding of design and software engineering principles
- A commitment to writing clean, understandable code
- Understanding of testing concepts, methodologies and processes
- Keen advocate of Agile methodologies
Desirable:
- Experience in the Financial Services Sector
- Familiarity with the Hortonworks Data Platform (HDP)
- Scrum Alliance Certified Scrum Developer or equivalent experience
- Enthusiastic supporter of Test/Behaviour driver development (TDD/BDD) approaches