Kafka Developer

Job Summary

We are looking for a skilled Apache Kafka Developer to design, develop, implement, and maintain real-time data streaming solutions using Apache Kafka. The ideal candidate should have experience with event-driven architectures, messaging systems, distributed systems, and microservices.

Key Responsibilities

• Design, develop, and maintain Kafka-based data streaming platforms.

• Create and manage Kafka producers, consumers, topics, partitions, and brokers.

• Develop real-time data pipelines and event-driven applications.

• Monitor Kafka clusters and ensure high availability, scalability, and performance.

• Implement data integration solutions with databases, APIs, and cloud platforms.

• Troubleshoot Kafka performance, connectivity, and replication issues.

• Collaborate with application development, DevOps, and data engineering teams.

• Implement security measures including authentication, authorization, and encryption.

• Optimize Kafka configurations for throughput and reliability.

Required Skills

• Strong experience with Apache Kafka.

• Proficiency in Java, Scala, or Python.

• Experience with Kafka Connect, Kafka Streams, KSQL/KSQLDB.

• Knowledge of distributed systems and microservices architecture.

• Experience with ZooKeeper (or KRaft architecture in newer Kafka versions).

• Understanding of REST APIs and messaging patterns.

• Familiarity with Linux/Unix environments.

• Experience with CI/CD pipelines and DevOps practices.

Preferred Skills

• Experience with Confluent Platform.

• Knowledge of cloud platforms such as AWS, Azure, or GCP.

• Experience with Docker and Kubernetes.

• Understanding of Spark, Hadoop, or other big-data technologies.

• Monitoring tools such as Prometheus, Grafana, ELK, or Splunk.

Qualifications

• Bachelors degree in Computer Science, Information Technology, or related field.

• Relevant experience in Kafka administration, development, or data engineering.