Lead Data Engineer

Role & responsibilities

10-12+ years experience, should be a solid DE with Kafka - need Immediate joiner

Hyderabad

Lead Data Engineer

Job Summary

We are looking for an experienced Lead Data Engineer with 10–12+ years of experience in designing, developing, and leading scalable data engineering solutions. The ideal candidate should be a strong hands-on Data Engineer with deep expertise in Apache Kafka and real-time data streaming.

The candidate will be responsible for building high-performance data pipelines, driving technical architecture, mentoring engineers, and partnering with cross-functional teams to deliver reliable and scalable data platforms.

Key Responsibilities

• Lead the design, development, and implementation of scalable batch and real-time data pipelines.
• Build and maintain robust Kafka-based streaming solutions for high-volume data processing.
• Design Kafka topics, partitions, consumer groups, replication strategies, and data retention configurations.
• Develop high-quality, scalable ETL/ELT pipelines and data processing frameworks.
• Work with large datasets and optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot complex production issues across data pipelines and streaming applications.
• Define and drive data engineering best practices, coding standards, testing, monitoring, and CI/CD.
• Participate in data architecture and technical design discussions.
• Perform code reviews and provide technical guidance to other data engineers.
• Mentor team members and act as