Kafka Engineer

Role & responsibilities :

We are seeking an experienced Kafka Engineer with strong expertise in designing, implementing, and supporting event-driven architectures using Apache Kafka. The ideal candidate will be responsible for building scalable, high-performance streaming data platforms, integrating enterprise applications, and ensuring reliability, availability, and performance of Kafka ecosystems.

Key Responsibilities

Kafka Platform Development

• Design, develop, and implement enterprise-grade streaming solutions using Apache Kafka.
• Build real-time data pipelines and event-driven integration architectures.
• Develop Kafka producers, consumers, and stream processing applications.
• Implement topic design, partitioning strategies, replication, and retention policies.
• Optimize Kafka clusters for performance, scalability, and fault tolerance.

Platform Administration & Support

• Install, configure, monitor, and maintain Kafka clusters.
• Perform capacity planning, performance tuning, and troubleshooting.
• Ensure high availability and disaster recovery readiness.
• Monitor cluster health using observability and monitoring tools.
• Resolve production incidents and provide L3 support.

Integration & Development

• Integrate Kafka with enterprise systems, APIs, databases, cloud platforms, and microservices.
• Develop real-time data ingestion and streaming solutions.
• Work closely with application teams to define event schemas and messaging standards.
• Implement Schema Registry and data governance standards.

DevOps & Automation

• Automate deployment and operational activities using CI/CD pipelines.
• Support containerized Kafka deployments on Kubernetes/OpenShift.
• Develop Infrastructure-as-Code (Terraform, Ansible, Helm) solutions.
• Implement security controls including authentication, authorization, and encryption.

Required Technical Skills

Kafka Expertise

• Strong hands-on experience with:
• Apache Kafka
• Kafka Connect
• Kafka Streams
• Confluent Platform
• Schema Registry
• KRaft / ZooKeeper
• MirrorMaker

Development Skills

• Java, Spring Boot
• Python
• REST APIs
• Microservices Architecture

Cloud & DevOps

• AWS, Azure, or GCP
• Docker
• Kubernetes/OpenShift
• Jenkins/GitHub Actions/Azure DevOps

Monitoring Tools

• Prometheus
• Grafana
• ELK Stack
• Splunk

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years of software engineering experience.
• 3+ years of hands-on experience with Apache Kafka.
• Experience working in Agile delivery environments.

Preferred Skills

• Confluent Kafka Certification.
• Event-Driven Architecture (EDA) expertise.
• Experience with large-scale distributed systems.
• Knowledge of Avro, Protobuf, and JSON schema management.
• Experience with airline, travel, retail, or financial services domains.

Key Deliverables

• Kafka architecture and solution design.
• Real-time event streaming platform implementation.
• High-availability Kafka cluster setup and management.
• Monitoring and performance optimization dashboards.
• Production support and operational runbooks.

Mandatory Skills- Kafka

Desirable Skills- APACHE KAFKA,KAFKA AND STORM,Java,Spring Boot Docker

Exps - 5yrs to 10yrs

Notice Period - Immediate Joiner to 15 days

location - Greater Noida