Description
Start date: ASAP
Location: Brussels, Belgium
Duration: 12months +
Languages: English. Dutch or French is considered a plus.
You are our next senior Hadoop developer if
- You have a demonstrable knowledge of HDFS and Hadoop x.0
- You have experience in YARN, HDFS federation
- You are comfortable with Hadoop client and Hadoop commands
- You are able to explain various tools and frameworks in Hadoop X.0 ecosystem
- You are able to run and monitor MapReduce job and fluent with the architecture of MapReduce
- You are well aware of SPARK and willing to dive into the technical details of SPARK alongside MapReduce
- You have the experience of writing Pig script to explore and transform data in HDFS
- You are able to create advance Pig relations and apply structure to unstructured Big Data
- You have the experience of exploring data, preparing data, computing quantiles, working with datasets using pig
- You are comfortable in writing Hive queries and design a proper schema for Hive
- You have the experience of using HCatalog with Hive and Pig
- You are comfortable in performing analysis, computation (ngrams), dataset operations with Hive
- You have experience in working with streaming data (with Hive and R/Python)
- You have experience and able to explain Sqoop (data transfer), Oozie (workflow) etc
Michael Bailey International is acting as an Employment Business in relation to this vacancy.