Big Data Engineer

Lesser Poland Voivodeship, Krakow  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.


Big Data Apache Hadoop SQL Databases Apache Spark Java (Programming Language) Data Analysis Business Requirements Unix Cloud Computing Linux Github Apache Hive Python (Programming Language) Unix Shell Systems Development Life Cycle Ansible Scala (Programming Language) Software Engineering Stakeholder Management Scripting Apache Yarn Spring-boot Git Pyspark Deployment Automation Restful Api Software Version Control Jenkins


Location: Krakow, Poland

Experience: 7+ years

Skills: Hadoop components (Apache Hadoop, Apache Spark, YARN, Hive, SQL),Python, pySpark and Unix/Linux environment


Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)
Experience optimizing Spark jobs and should have Basic shell-scripting knowledge
Understanding of big data modelling techniques using relational and non-relational techniques
Needs to be a Self-starter, proactive and with a team focused attitude.
Willingness to learn and quick to adapt to changing requirements.
Experience and understanding of SDLC (Software Development Lifecycle)
Ability to work with business users and the team stakeholders such as project managers and architects


Excellent data analysis skills with experience dealing with large and complex data sets.
Good knowledge of Structured Query Language (SQL)
Highly analytical with excellent attention to detail.
Experienced in analysing business requirements and turning them into effective functional solutions
Experience in Scala
Experience with developing RESTful APIs using Java Springboot
Familiar with Cloud technology

Language: English
Contract:6 month + Extension
Job Types: Full-time, Contract
Start date
6 months
(extension possible)
N Consulting UG
Published at
Contact person:
Kirubanandam Swayamprakasam
Project ID:
Contract type
To apply to this project you must log in.