Kafka Developer

Senior Confluent Kafka Developer

Role Summary

Handson developer responsible for building, configuring, testing, and supporting Kafkabased streaming pipelines, following defined architectural standards.

Common Requirement:

• 5+ years overall IT experience
• 5+ years on Kafka / Confluent platforms working on Kafka Core, KStream, KSQL, Kafka Connect.
• Certifications: CCDAK / CCAAK Preferred
• Soft Skills: Clear communication, documentation, ownership mindset
• Strong handson Kafka & Confluent experience.
• Java and/or Python based Kafka client development.
• Experience in regulated / BFSI environments preferred.
• Good understanding of data quality, replay, and recovery patterns.

Core Responsibilities

Kafka Core & Topics

• Create and manage Kafka topics with appropriate:
• Partitions, replication, retention, compaction
• Implement topiclevel security (ACLs / RBAC) and naming conventions.
• Work with Schema Registry for schema creation and evolution.

ksqlDB

• Develop and maintain:
• Streams, tables, persistent queries
• Joins, aggregations, windowing logic
• Handle error streams, DLQs, and reprocessing logic.

Kafka Streams

• Build Kafka Streams applications using KStreams DSL.
• Implement stateful and stateless transformations.
• Optimize performance and manage state stores.

Kafka Connect

• Configure and operate:
• Source connectors (RDBMS, IBM MQ, Files, APIs, CDC)
• Sink connectors (NoSQL, RDBMS, Cloud targets)
• Apply converters and Single Message Transforms (SMTs).
• Tune error handling, retries, DLQ behavior.

Custom Producers & Consumers

• Develop highthroughput producers and consumers using Java / Python.
• Implement idempotence, offset management, consumer groups.
• Build custom logic for enrichment, validation, decryption where required.

DevOps & Operations

• Use CI/CD pipelines to deploy:
• Topics, connectors, ksqlDB queries
• Kafka Streams applications
• Support monitoring and troubleshooting using Control Center / logs / metrics.