Data Engineer

Role & responsibilities

Data Engineer

Job Summary

We are looking for an experienced Lead Data Engineer with 69 years of experience in designing, developing, and leading scalable data engineering solutions. The ideal candidate should be a strong hands-on Data Engineer with deep expertise in Apache Kafka and real-time data streaming.

The candidate will be responsible for building high-performance data pipelines, driving technical architecture, mentoring engineers, and partnering with cross-functional teams to deliver reliable and scalable data platforms.

Key Responsibilities

• Lead the design, development, and implementation of scalable batch and real-time data pipelines.
• Build and maintain robust Kafka-based streaming solutions for high-volume data processing.
• Design Kafka topics, partitions, consumer groups, replication strategies, and data retention configurations.
• Develop high-quality, scalable ETL/ELT pipelines and data processing frameworks.
• Work with large datasets and optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot complex production issues across data pipelines and streaming applications.
• Define and drive data engineering best practices, coding standards, testing, monitoring, and CI/CD.
• Participate in data architecture and technical design discussions.
• Perform code reviews and provide technical guidance to other data engineers.
• Mentor team members and act as

Preferred candidate profile