Description
My customer is looking for English speaking Data engineers to work near Amsterdam on a 5 month project.
Responsibilities:
- Design and implement distributed data processing pipelines using Spark, Hive, Sqoop, Python, and other tools and languages prevalent in the Hadoop ecosystem. Ability to design and implement end to end solution.
- Build utilities, user defined functions, and frameworks to better enable data flow patterns.
- Research, evaluate and utilize new technologies/tools/frameworks centered around Hadoop and other elements in the Big Data space.
- Define and build data acquisitions and consumption strategies
- Build and incorporate automated unit tests, participate in integration testing efforts.
- Work with teams to resolving operational & performance issues Qualification:
- MS/BS degree in a computer science field or related discipline
- 6+ years' experience in large-scale software development
- 1+ year experience in Hadoop or big data technologies.
- Strong Java programming, Python, Shell Scripting, and SQL
- Strong development skills around Hadoop, Spark, Hive, and Pig
- Good understanding of file formats including JSON, Parquet, Avro, and others
- Experience with performance/scalability tuning, algorithms and computational complexity
- Work with teams to resolving operational & performance issues
Qualification:
- MS/BS degree in a computer science field or related discipline
- 6+ years' experience in large-scale software development
- 1+ year experience in Hadoop or big data technologies.
- Strong Java programming, Python, Shell Scripting, and SQL
- Strong development skills around Hadoop, Spark, Hive, and Pig
- Good understanding of file formats including JSON, Parquet, Avro, and others
- Experience with performance/scalability tuning, algorithms and computational complexity
Start: ASAP
Duration: 5 Months + extensions
Location: Amsterdam, Netherlands
Language: English
Rate: Market
If you are interested, please send me your latest CV in Word format and I will call you to discuss further.
Candidates MUST have a current UK/EU passport or Valid work visa as we are unable to sponsor work permits.
I look forward to your response