Kafka Developer

Job Overview

We are looking for an experienced Kafka Developer with 4+ years of experience in designing and developing real-time data streaming and event-driven applications using Apache Kafka. Strong SQL knowledge and experience in data pipelines are highly preferred.

Key Responsibilities

• Design and develop scalable Kafka producers and consumers.
• Develop and maintain real-time Kafka-based data pipelines.
• Work with Kafka topics, partitions, consumer groups, offsets, and replication.
• Implement message processing, retries, error handling, and DLQ mechanisms.
• Monitor and troubleshoot consumer lag, performance, and production issues.
• Integrate Kafka with databases, APIs, microservices, and downstream systems.
• Develop SQL queries for data transformation, validation, and reconciliation.
• Support event-driven architecture and high-volume data processing.
• Collaborate with Data Engineers, Developers, DBAs, and DevOps teams.

Required Skills:

• 4+ years of hands-on Apache Kafka experience.
• Strong knowledge of Kafka Producers, Consumers, Topics, Partitions, and Consumer Groups.
• Strong SQL skills with experience in complex queries and data validation.
• Experience with real-time data pipelines and database integration.
• Experience with Kafka troubleshooting and performance optimization.