Manager, Data Engineering

Job Summary

Manages the activities of a team of data analysts and newer data engineers responsible for developing software code that formats, tags, processes, stores and serves data. Manages the development of data pipelines to ensure that they are scalable, repeatable, and secure and can serve multiple groups at Vanguard.

Role Summary

The Manager, Data Engineering is responsible for leading a team of data engineers to design, develop, and optimize scalable data pipelines and infrastructure. This role focuses on enabling high-performance data workflows, ensuring seamless data integration and driving automation to enhance data accessibility.

Responsibilities

• Lead, coach, and develop a high-performing team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement.
• Define and execute data engineering strategy, architecture, and roadmaps aligned with business and enterprise data objectives.
• Design, build, and maintain scalable data pipelines, integration frameworks, and cloud-native data platforms.
• Drive the development of data warehouses, lakehouse solutions, data products, and analytical platforms that support enterprise reporting and insights.
• Establish standards for data quality, governance, observability, security, and operational excellence.
• Partner with data science, analytics, product, and business teams to deliver reliable and scalable data solutions.
• Ensure data platforms are secure, resilient, performant, and compliant with enterprise technology standards.
• Champion automation, DevOps practices, and modern engineering methodologies to improve delivery efficiency and reliability.
• Provide technical leadership for evaluating and adopting emerging technologies and data engineering best practices.
• Manage delivery planning, stakeholder communications, risk management, and execution of strategic data initiatives.

Qualifications and Skills

• Minimum 8 years of relevant work experience, with at least 5 years in a leadership role managing data engineering teams and large-scale data infrastructure.
• Bachelor's degree (B.E./B.Tech) in Computer Science, IT, or a related field or Diploma in Data Science/Data Engineering.
• Proven experience designing and delivering enterprise-scale data platforms and data products.
• Strong expertise in ETL/ELT development, data warehousing, data modeling, and distributed data processing.
• Hands-on experience with Python, PySpark, SQL, Apache Spark, Kafka, and modern data engineering frameworks.
• Experience building cloud-native data solutions utilizing AWS and Databricks technologies.
• Strong understanding of data governance, data quality, security, and operational monitoring.
• Experience working within Agile delivery models and leading cross-functional technology teams.
• Excellent communication, stakeholder management, and problem-solving skills.

Preferred Qualifications

• Experience with AWS services including S3, EMR, Glue, Lambda, Kinesis, Athena, and Redshift.
• Experience with Databricks, Delta Lake, Unity Catalog, and Lakehouse architecture.
• Knowledge of Data Mesh, Data Products, Semantic Modeling, and Metadata Management.
• Experience with business intelligence and analytics platforms such as Tableau, Power BI, or Amazon QuickSight.
• Exposure to AI-enabled data platforms and Agentic AI solutions.
• Financial services or other regulated industry experience.
• Experience leading enterprise data transformation initiatives and globally distributed engineering teams

Location

Hyderabad, Telangana

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.