Description
Big Data Developers are urgently required by a leading Global IT Vendor for a long term assignment in the Telco sector in Rome, Italy. The contract will be a minimum 18 month term, with possible extensions, the successful Candidates will need to be located in Rome, or be willing to travel weekly.
The following is required:
Skills
Solid knowledge in Java, Python, or Scala (more than one is desirable);
Solid knowledge in Data Modeling, Data Warehousing and MPP databases (Greenplum, Teradata, Netezza);
DevOps as a cultural mindset; DataOps is a big plus
Logging frameworks (Log4j and similar)
Python (pandas, numpy) - highly desirable
Java, Spring, Java IDE, Microservices, Message and Queueing
Hadoop ecosystem (HDFS, Hive and Spark; a plus is HBase, Atlas and Ranger)
Spark (RDD, DataFrames, SparkSQL)
Applications performance bechmarking and optimization
Job schedulers (IBM/Tivoli, Oozie and a similar) à not a MUST
Basic SQL: simple queries, joins, indexes
Comfort level of experience with bash and Unix commands - cd, cp, mv, ls, rm, grep, head, tail, tr, du, df, free, top, ps, kill, locate
Monitoring tools (Grafana, Prometheus, Zabbix, etc.)
Open-source contribution record is a BIG plus
Duties
Development of Big Data solutions to process data in Real Time and batch with technologies as: Spark, Hadoop, Kafka, Scala
Developes Scripts and Code tofully support data collection and integration activities
Technical advisory for software developers and Data Scientists including participation in code reviews.
Responsible for Code Optimiztion and to produce ready-to-production SW solutions.
Analysis, planning and execution of massive data migrations.
Performance analysis of SW solutions and Platform Solution
Data Analysis and Visualization with Python and or other advanced Languages
Graph Analytics and ML Solution development for Big Data