Lead I - Data Engineering

Role Description

• Strong expertise in SQL for complex query development, data extraction, transformation, analysis, and performance optimization.
• Proficient in Python programming for data processing, automation, data cleansing, transformation, and aggregation tasks.
• Hands-on experience with Microsoft Azure, including Azure Data Factory (ADF) and Azure Databricks for building scalable data solutions.
• Experience developing and managing ETL/ELT pipelines to integrate data from databases, APIs, and other structured and unstructured sources.
• Strong knowledge of Databricks and Apache Spark for large-scale data processing, engineering workflows, and notebook-based development.
• Skilled in ensuring data quality, integrity, and governance, including troubleshooting and resolving data-related issues across enterprise platforms.
• Proven ability to collaborate with business stakeholders, analysts, and data scientists to deliver data-driven solutions while maintaining and optimizing existing pipelines and reporting platforms.

Skills SQL, Apache Spark, Microsoft Azure, Databricks