Description
Big Data Developer
Location: Dublin City Centre
Duration: 12 months rolling contract
Are you a Big Data Developer searching for your next contract position? A major client of Stelfox's are looking to recruit a Big Data Developer to join the team in Dublin in the creation of their new Big Data Pipeline in the Hadoop environment.
We are looking for someone skilled in Hadoop, Kafka, Scala, Python, Spark and Hive, with great communication skills. You'll be one of two developers on the team, so the ideal candidate will be someone who can work independently and really own and be proud of your work.
Are you ready to put your expertise in Big Data to work in a new challenge, in a hands-on, development position as you all work towards this new infrastructure? Then keep reading below for more.
Your day to day will include:
- General Programming bearing in mind Big Data architecture of this new pipeline
- Data formats and Big Data formats
- SPARK written in Scala, Java or Python
- Bash/Shell Scripting
- Hadoop File System
- An understanding of Javascript to host job configuration details
- ETH (Jenkins/NEXUS/Maven/GIT/JIRA)
- A knowledge of high-level Groovy Scripting, for use with Jenkins
- Hive/BigSQL (TEXTFILE, SEQUENCEFILE, RCFILE, AVRO, ORCFILE, PARQUET)
- SQL Hbase and Kafka for Real Time processing
- Working closely with the team, mentoring junior members, and making sure everyone is focused on the end goal
- Working closely with the dev team to ensure all bug fixes, and changes are correct before going live with the pipeline
This is a solid, 12+ month contract building the data pipelines, migrating from their previous system to Hadoop
If you are excited by the prospect of putting your skills to the test in a new position, apply today for immediate consideration or contact me directly (see below)