Solution Lead

Job Description

We are looking for an experienced Solution Lead / Manager to drive enterprise-scale data engineering and cloud transformation initiatives. The ideal candidate will have strong expertise in Azure Databricks, PySpark, Python, ETL Development, Azure Data Factory, and Informatica, along with experience leading teams and delivering robust, scalable data solutions.

Key Responsibilities

• Lead end-to-end design and implementation of cloud-based data engineering solutions.
• Develop and optimize data pipelines using Azure Databricks, PySpark, and Python.
• Build and maintain ETL/ELT workflows using Azure Data Factory and/or Informatica.
• Design data ingestion, transformation, and validation processes ensuring high data quality.
• Collaborate with business stakeholders and global teams to understand and deliver data requirements.
• Perform performance tuning, optimization, and troubleshooting of large-scale data workloads.
• Mentor and guide engineering teams on Azure and data engineering best practices.
• Drive solution architecture, technical design, and project delivery.

Required Skills

• 8+ years of IT experience with strong Data Engineering background.
• Hands-on experience in:
• Azure Databricks
• PySpark
• Python
• ETL Development
• Azure Data Factory (ADF)
• Informatica
• SQL
• Azure Data Lake
• Strong understanding of data modeling, data warehousing, and cloud architecture.
• Experience in performance tuning, partitioning, and optimization of data pipelines.
• Excellent stakeholder management and team leadership skills.

Preferred Skills

• Exposure to Azure Synapse Analytics.
• Agile/Scrum experience.
• Experience in enterprise ERP or finance data environments.

Education

• B.E./B.Tech (Computer Science / IT) / MCA / MBA (Systems/IT) or equivalent qualification.