Description
One of my clients, a large bank in Copenhagen are currently looking for Big Data Developers to join the team on a contract basis.
This will initially be 3 months but my client has said there is a very high potential for extension.
You will be working in the company's Data Engineering team as a BigData Engineer. Here you'll have a once in a lifetime opportunity to be a key part of designing and building the companies next core data platforms. As a BigData Engineer you will develop, maintain, test and evaluate BigData solutions within the companies next generation BigData Platform.
Key responsibilities include:
Building distributed and highly parallelized BigData processing pipeline which process massive amount of data (both structured and unstructured) in near Real Time
Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
Work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment
Requirements:You should have:
Experience in Scala or Java/Spark (and willingness to learn Scala).
Knowledge of:
o Hadoop stack: YARN, MR, Sqoop, Hive,
o Kafka,
o Impala,
Hands on development experience with Jenkins or Bamboo, JIRA, Bitbucket and Git/Stash.
Ideally you also have:
Experience of implementing data security capabilities such as encryption and anonymization
Excellent communication skills and experience of distributed global teams.
Data driven thinking capabilities,
Experience in using Agile methods,
Solid grounding in Financial Service.