Description
Our Client, a leading Technical Consultancy, are seeking a Senior Level Big Data Engineer with specific expertise in Scala and Spark to join their Big Data team on a 6 month initial contract.
The essential skills for this role:
- At least 5 years of data engineering, data science, or software engineering experience
- Experience in analysing text, streams with emerging Hadoop-based big data, NoSQL
- Hands on experience with running Pig and Hive Queries
- Analysing data with Hive, Pig and HBase Data scrubbing and processing with Oozie
- Experience with an Object Oriented programming language - must demonstrate experience with Scala.
- Experience with sizing and estimating large scale big data project
Essential Responsibilities will include
- Work with many of the exciting and highly visible Big Data technologies like Cloudera, Hadoop, Spark, HIVE, Impala, Cassandra
- Primary tools used will be Scala and Spark
- Utilize ETL/ELT systems and integration technologies using event and messaging systems such as Storm, Flume and Kafka.
- Develop solutions to complex business problems such as the reducing churn, retaining customers and growing revenue
If you would like to hear more about this position and are available immediately, please send through your CV, I would be happy to share more details on the role.