Upgrade Post project

Big Data Engineer

Leuven  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Keywords

Programming Monitoring Consulting Programming Languages Python Big Data Hadoop Communication NoSQL SQOOP

Description

NextLink is working with top notch consulting company, who is seeking for a Big Data Engineer in Leuven, Belgium for a 12 months contract

Job Title: Big Data Engineer

Duration: 12 Months contract

Location: Leuven, Belgium

Responsibilities: 


  1. Designing, developing, constructing, testing and maintaining the complete data management & processing systems – Data Pipelines
  2. Aggregate & Transform raw data coming from a variety of data sources to fulfill the functional & non-functional business needs – Data Transformation
  3. Discovering various opportunities for data acquisitions and exploring new ways of using existing data – Data Ingestion
  4. Creating of data models to reduce system complexity and hence increase efficiency and reduce cost – Data Architecture & Models
  5. Performance optimization & monitoring: automating processes, optimizing data delivery & re-designing the complete architecture to improve performance
  6. Proposing ways to improve data quality, reliability & efficiency of the whole system – Data Quality
  7. Creating a solution by integrating a variety of programming languages and tools together – Data Value
  8. As a senior, it is expected to be very well communicative and to be extravert for what concerns solutions (technical-architectural), actively helping and supporting the other team members.

Competencies


  1. Store:


  • Data Modelling
  • Data Architecture
  • Big Data Framework / Hadoop: HDFS, Squid, Spark, Conda, Yarn and MapReduce
  • NoSQL Databases: Cassandra, Hbase, MongoDB


  1. Access & Transport – Connectivity:


  • ETL ( Extract, Transform, Load ) : Informatica
  • Big Data Framework / Hadoop : Flume & Sqoop, Yarn, Zookeeper


  1. Enrich :


  • Real-time processing framework – Apache Spark
  • Big Data Framework / Hadoop : PIG, Hive
  • SQL and NoSQL
  • Machine learning (nice to have): Python & algorithms


  1. Provision :


  • Workflow
  • Programming : Java, Python (and optionally Scala)


  1. Development methodologies :


  • Agile : Safe or Spotify
  • DataOps


  1. Ancillary capabilities :


  • Very strong communication skills
  • Problem Solving
  • Teamwork
  • Innovation

Start date
02.2021
From
Next Link Solutions
Published at
16.02.2021
Project ID:
2051102
Contract type
Freelance
To apply to this project you must log in.
Register