Lead Data Engineer

Company Description Vivid Pulse connects talented professionals with leading companies across India and internationally, focusing on making job searches faster, smarter, and more transparent. The organization curates and posts verified roles across sectors such as Information Technology, Product Management, Sales and Marketing, Finance and Accounting, HR and Recruitment, Operations, and Customer Success. Vivid Pulse supports both experienced professionals and recent graduates by providing timely access to relevant career opportunities. Employers seeking to hire can also partner with Vivid Pulse to reach qualified candidates efficiently.

Role Description The Lead Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics and business intelligence initiatives. This full-time, on-site role is based in Bengaluru and involves leading the data engineering team, defining best practices, and ensuring data quality, reliability, and security. Day-to-day responsibilities include architecting data models, optimizing ETL processes, overseeing data warehousing solutions, and collaborating with data analysts, data scientists, and product stakeholders to translate business requirements into robust data solutions. The Lead Data Engineer will also monitor performance, troubleshoot issues, mentor team members, and contribute to technology roadmaps and tool selection.

Qualifications

• Candidates should possess strong data engineering skills, including experience with large-scale data systems and distributed processing.
• Candidates should possess data modeling and data warehousing skills to design efficient schemas and manage structured and semi-structured data.
• Candidates should possess Extract Transform Load (ETL) skills to build, optimize, and maintain reliable data pipelines from multiple sources.
• Candidates should possess data analytics skills to support reporting, dashboards, and insight generation for business stakeholders.
• Proficiency in SQL and at least one programming language commonly used in data engineering (such as Python, Scala, or Java).
• Experience with modern data platforms and tools (for example, cloud data warehouses, data lakes, distributed processing frameworks, and orchestration tools).
• Demonstrated ability to lead technical projects, mentor engineers, and collaborate with cross-functional teams.
• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
• Strong problem-solving skills, attention to detail, and a commitment to data governance, security, and compliance.