Manager

Job Summary

We are looking for a skilled Kafka Engineer with 3-6 years of experience in designing, developing, and maintaining real-time data streaming and integration solutions. The ideal candidate will have strong expertise in Apache Kafka, integration patterns, messaging systems, and API-based architectures.

The opportunity : Manager-GOV-Tech Consulting-CNS - TC - Technology Strategy & Transformation - New Delhi

Responsibilities

Kafka & Messaging

• Design, develop, and manage Kafka topics, partitions, schemas, and related configurations.
• Build and maintain Kafka producers/consumers, connectors, and streaming applications.
• Manage Kafka clusters, monitoring performance, throughput, and availability.
• Implement Kafka Connect (source/sink connectors) and Schema Registry.

Integration & Middleware

• Develop and maintain integration flows using messaging systems (Kafka, MQ, JMS, etc.).
• Implement enterprise API integrations, web services (REST/SOAP), and microservice communication patterns.
• Work with integration tools/frameworks such as Spring Integration, Apache Camel, MuleSoft, or similar.
• Troubleshoot and optimize distributed system performance issues.

Architecture & Best Practices

• Implement event-driven architecture (EDA) and integration design patterns.
• Ensure high availability, scalability, and fault tolerance across integration systems.
• Set up monitoring, logging, and alerting for Kafka & integration platforms (e.g., Prometheus, Grafana, Splunk, ELK).
• Collaborate with architecture, DevOps, and application teams for end-to-end delivery.

DevOps & Automation

• Build CI/CD pipelines for integration and streaming applications.
• Automate deployment and configuration of Kafka components.
• Work with containerized environments (Docker, Kubernetes).

Required Skills

• 3-6 years hands-on experience with Apache Kafka (brokers, producers, consumers, Connect, Streams).
• Strong knowledge of Kafka internals, partitions, replication, retention, and consumer groups.
• Experience with Java / Spring Boot, or Python for building integration services.
• Solid understanding of integration patterns, message queues, and microservices.
• Experience with REST APIs, JSON, XML, and data serialization formats (Avro/Protobuf).
• Experience with Linux, shell scripting, and system troubleshooting.
• Familiarity with Git, CI/CD tools (Jenkins, GitLab, Azure DevOps, etc.).

Good-to-Have Skills

• Experience in Openshift and managed Kafka services (MSK, Confluent Cloud, Aiven).
• Knowledge of container orchestration (EKS/AKS/GKE).
• Exposure to Confluent Platform (KSQL, Control Center).
• Experience with other messaging systems: RabbitMQ, ActiveMQ, Azure Service Bus, IBM MQ.
• Understanding of data pipelines, ETL processes, and streaming analytics.

Education

• Bachelor's degree in Computer Science, IT, or related field (or equivalent experience).

Soft Skills

• Strong analytical and problem-solving abilities.
• Good communication and documentation skills.
• Ability to work in cross-functional teams and fast-paced environments.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.