Python + Databricks Lead

1. Python with Panda hands on
2. SQL hands on
3. Stored Procedure – hands on
4. ETL Pipeline Support experience is preferred

Lead and support the development and enhancement of data pipelines & Stored Procedures using Python

Job Description

Provide support for existing data pipelines ensuring smooth data flow and timely issue resolution Develop and implement enhancements to data pipelines using Python to improve performance and scalability Collaborate with cross functional teams to gather requirements and design efficient data processing solutions Monitor pipeline performance and troubleshoot any data related issues proactively Lead the team by providing technical guidance mentoring and coordinating tasks to meet project deadlines

Roles and Responsibilities

Lead and manage a team of data engineers focused on pipeline development and support Oversee the design development and deployment of robust data pipelines using Python Ensure data quality integrity and security throughout the pipeline processes Collaborate with stakeholders to understand business needs and translate them into technical solutions Conduct code reviews provide constructive feedback and enforce best practices Drive continuous improvement initiatives to optimize pipeline efficiency and reliability Facilitate communication within the team and across departments to ensure alignment and successful project deliveryRole & responsibilities

Preferred candidate profile