Kafka Admin

Educational Requirements Service Line Responsibilities

• Install, configure, and manage Apache Kafka clusters in production and non-production environments
• Monitor Kafka cluster health, performance, and capacity using tools such as Prometheus, Grafana, or similar
• Perform cluster tuning and optimization to ensure high throughput and low latency
• Manage Kafka topics, partitions, brokers, replication, and retention policies
• Implement and maintain data security, including authentication (SASL), authorization (ACLs), and encryption (SSL/TLS)
• Troubleshoot and resolve Kafka-related issues, including broker failures, consumer lag, and data inconsistencies
• Automate routine tasks using scripting (Shell, Python, etc.) and configuration management tools
• Work closely with development teams to design scalable and fault-tolerant data streaming solutions
• Perform upgrades, patching, and maintenance with minimal downtime
• Ensure backup and disaster recovery mechanisms for Kafka clusters
• Maintain documentation for configurations, processes, and troubleshooting guides

Additional Responsibilities Technical and Professional Requirements

• 2-5 years of experience working with Apache Kafka administration/support
• Strong understanding of distributed systems and messaging architectures
• Hands-on experience with Kafka ecosystem tools (Zookeeper/KRaft, Kafka Connect, Kafka Streams)
• Experience with monitoring tools such as Prometheus, Grafana, or ELK stack
• Knowledge of Linux/Unix systems administration
• Familiarity with cloud platforms like AWS, Azure, or GCP
• Experience with containerization and orchestration tools (Docker, Kubernetes) is a plus
• Understanding of data pipelines, ETL processes, and streaming concepts
• Strong troubleshooting and analytical skills
• Good scripting knowledge (Bash, Python, or similar)

Preferred Skills