Description
Job description:
Job Title: System Architect-Big Data/Data Analytics
Location: Vimercate, Italy
Job Type: Contract
Responsibilities:
- Requirements gathering for Network planning solution containing Big Data Applications solutions.
- Define needed content solution with technical experts/feature owners
- Translate use cases of customer solution into SW development items
- Create architectural standards on how use case can be implemented on top of platform.
- Design and build concept solutions, design and implement Big Data solutions to meet specific use cases
- Works hands-on with code for big data processing with Apache Spark
- Produces and maintains technical specifications, user stories, and other similar artifacts
- Reviews code and related documentation (requirements, design documents, user documentation including training material)
- Actively shares and distributes technical information within software Architect team
- Follows new features and changes in external systems and open source components
Required competence:
- Experience on design complex and distributed SW architecture using existing framework/platform
- Experience programming with either Java, Scala C#
- Knowledge of Design Pattern paradigm
- Distributed system architecture understanding
- Experience in using Apache Spark, Impala, Kafka
- Big data file formats: Parquet, Avro
- Experience in using notebooks like Zeppelin and BI tools for data analysis
- Experience with distributed, highly available and scalable systems
- Experience in agile software development
- Experience in working in Continuous Integration/Delivery SW process
- Big data stack knowledge (HDFS, Mesos)
- NoSQL database knowledge (Cassandra)
DevOps competencies:
- Being able to work in Linux is a must
- Scripting language experience (ex: Python)
- Bash Scripting experience
- Cloud: understanding basic concepts, AWS REST APIs
- Docker containers