Spark Engineer - Java/Scala, Spark, Kafka, DevOps

London  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Description

Spark Engineer - Java/Scala, Spark, Kafka, DevOps

My client is looking for an experienced contract Spark Engineer to join the team. The Spark Engineer will have a strong engineering background with experience in designing and building highly scalable, loosely coupled, event driven, distributed systems. You need to be an expert in writing Java functions, using Spark as an orchestration tool, consuming from and publishing to Kafka and building cloud ready applications.

Key skills:

  • Spark/Spark Streaming
  • Java 8 (preference) or Scala
  • Kafka
  • DevOps best practices, technologies and tools (Ansible, terraform)
  • Kafka Architecture and Design Patterns.
  • Architecture techniques, principles and approaches such as Event Driven Design, Domain Driven Design, Event Sourcing & CQRS
  • BDD/TDD practices

Desirable skills:

  • AWS
  • Fargate, EKS, EC2, EMR

Responsibilities:

  • Fostering an engineering mindset within the team
  • Establishing industry best practices for software development
  • Building systems out in the Cloud (AWS)
  • Adoption of DevOps best practices, tools and technologies

Please apply now for immediate consideration and further details.

Keywords: Spark Engineer, Spark, Java, Scala, Kafka, DevOps, AWS.

Scot Lewis Associates Ltd is acting as an employment business.

Start date
ASAP (will wait notice)
Duration
6 - 12 months (possible extensions)
(extension possible)
From
Scot Lewis Associates Ltd
Published at
21.01.2022
Project ID:
2296660
Contract type
Freelance
To apply to this project you must log in.
Register