Description
Urgently searching a Senior Software Engineer who has significant experience with the Data Streaming Platform, Kafka, along with excellent skills in Python, Java, Perl, SQL and good experience with automating and orchestrating distributed systems along with creating internal tools such as service discovery integrations or metrics pipelines.
The role primarily involves the deployment of the Data Streaming Platform, the core of which processes tens of billions of events every day. This means you will implement, coordinate, plan, and communicate about all aspects of the platforms usage.
In addition to this you will also:
- Develop and maintain utilities and libraries supporting the distributed infrastructure, mostly in Python.
- Build automation and improve the resilience of the systems
- Evaluate new technologies, run benchmarks, and perform capacity planning, for existing and future deployments
- Run performance analysis, optimization, and workload characteristics to minimize the resource utilization and effectiveness of the Back End
Ideally you will have other related skills such as MySQL, Cassandra, HDFS/Hadoop, along with monitoring systems (OpenTSDB, InfluxDB, Graphite) and log management systems eg Graylog, as well as orchestration frameworks like Ansible, Salt, etc...