Lead Data Engineer - Python, PostgreSQL, GCP Cloud (8+ Yrs)

Design, develop, test, deploy, and maintain large-scale, fault-tolerant data pipelines using Python, PostgreSQL, and Airflow on GCP Cloud.

Triage, debug, and optimize production pipeline failures, handling memory management, data quality, and edge cases.

Collaborate with cross-functional teams to gather requirements and design scalable dimensional data models (Facts, Dimensions, SCD Type 2).

Implement automated CI/CD pipelines (GitHub Actions/Jenkins) for efficient code promotion across DEV, UAT, and PROD environments.

Lead and mentor a team of engineers to ensure timely project delivery while enforcing code quality, unit testing, and best practices.

8–12 years of hands-on experience in Data Engineering with core expertise in Python, PostgreSQL, GCP (BigQuery/Cloud Storage), and Airflow.

Strong understanding of advanced SQL, query performance tuning (EXPLAIN ANALYZE), composite indexing, and partitioning.

Hands-on experience with CI/CD pipeline development (Jenkins, GitHub Actions, or similar tools).

Proven track record of managing small engineering teams, conducting code reviews, and coordinating with project management and clients.