Kafka Admin (polish based)

Warsaw  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Keywords

Apache Kafka Scalability Controles de Acceso Automation Business Continuity Capacity Planning Configuration Management Disaster Recovery Performance Management Cryptographic Protocols Fault Tolerance Maintenance Network Performance Stakeholder Management Workflows Apache Zookeeper Scripting Testing Data Ingestion System Availability Data Protection Resource Utilization Data Pipeline

Description

Job Description:
As a Kafka Administrator, you will be responsible for the design, implementation, and maintenance of our Kafka ecosystem, ensuring its scalability, reliability, and performance to meet the evolving needs of our organization. You will collaborate closely with data engineers, software developers, and other stakeholders to architect robust solutions and streamline data pipelines.

Your key responsibilities will include:

  • Installing, configuring, and managing Apache Kafka clusters, including brokers, ZooKeeper, Kafka Connect, and Kafka Streams, across development, testing, and production environments.
  • Monitoring Kafka cluster health, performance metrics, and throughput, and proactively identifying and addressing potential bottlenecks or issues.
  • Implementing security measures, access controls, and encryption protocols to safeguard data privacy and integrity within the Kafka ecosystem.
  • Managing Kafka topics, partitions, replication, and consumer groups, and optimizing configurations for efficient resource utilization and high availability.
  • Collaborating with cross-functional teams to design and implement data ingestion pipelines, Real Time processing workflows, and event-driven architectures.
  • Performing capacity planning, scaling, and disaster recovery planning to ensure scalability, fault tolerance, and business continuity.
  • Automating routine tasks, such as cluster provisioning, deployment, monitoring, and alerting, using configuration management tools and Scripting languages.
  • Staying abreast of industry best practices, emerging trends, and new features in Kafka and related technologies, and evaluating their applicability to our environment.
Start date
n.a
From
Brabers Consultancy
Published at
16.05.2024
Project ID:
2751247
Contract type
Freelance
To apply to this project you must log in.
Register