Lead Data Engineer

Bristlecone India Limited is seeking a seasoned Lead Data Engineer to spearhead the design, development, and delivery of robust data platforms within our Data Services - Delivery department. The role involves architecting scalable pipelines, optimizing Snowflake data warehouses, and leveraging Databricks for advanced analytics. You will mentor a team of engineers, collaborate with cross-functional stakeholders, and ensure data solutions meet performance, security, and compliance standards.

• 10+ years of professional experience in data engineering or related fields.
• Deep expertise in Snowflake architecture, performance tuning, and data warehousing.
• Strong hands-on experience with Databricks, Spark, and lakehouse concepts.
• Proficiency in SQL, Python, and/or Scala for data transformation.
• Demonstrated ability to lead and mentor technical teams.
• Experience with cloud platforms (AWS, Azure, or GCP) and associated services.
• Knowledge of data modeling, ETL/ELT design patterns, and data governance.
• Familiarity with CI/CD tools (e.g., Git, Jenkins, Azure DevOps) and IaC (Terraform, CloudFormation).
• Excellent problem-solving, communication, and stakeholder management skills.
• Bachelor s or Master s degree in Computer Science, Engineering, or a related discipline.

• Architect and implement end-to-end data pipelines on Snowflake and Databricks.
• Lead a team of data engineers, providing technical guidance and mentorship.
• Design data models and schemas that support business intelligence and analytics.
• Optimize query performance and cost efficiency in Snowflake environments.
• Develop and enforce data governance, security, and compliance best practices.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
• Implement CI/CD processes for data workflows and infrastructure as code.
• Monitor, troubleshoot, and resolve production data pipeline issues.
• Stay current with emerging data technologies and recommend strategic improvements.
• Prepare technical documentation and present solution architectures to leadership.