Description
Spark Engineer - Java/Scala, Spark, Kafka, DevOps
My client is looking for an experienced contract Spark Engineer to join the team. The Spark Engineer will have a strong engineering background with experience in designing and building highly scalable, loosely coupled, event driven, distributed systems. You need to be an expert in writing Java functions, using Spark as an orchestration tool, consuming from and publishing to Kafka and building cloud ready applications.
Key skills:
- Spark/Spark Streaming
- Java 8 (preference) or Scala
- Kafka
- DevOps best practices, technologies and tools (Ansible, terraform)
- Kafka Architecture and Design Patterns.
- Architecture techniques, principles and approaches such as Event Driven Design, Domain Driven Design, Event Sourcing & CQRS
- BDD/TDD practices
Desirable skills:
- AWS
- Fargate, EKS, EC2, EMR
Responsibilities:
- Fostering an engineering mindset within the team
- Establishing industry best practices for software development
- Building systems out in the Cloud (AWS)
- Adoption of DevOps best practices, tools and technologies
Please apply now for immediate consideration and further details.
Keywords: Spark Engineer, Spark, Java, Scala, Kafka, DevOps, AWS.
Scot Lewis Associates Ltd is acting as an employment business.