Data Engineer

Job Title: Data Engineer – GCP + PySpark

Experience: 5–6 Years We are looking for a skilled

Data Engineer with hands-on experience in

GCP, Python, and PySpark to build and optimize scalable data pipelines and ETL workflows.

Key Skills

• Strong experience in Python, PySpark, GCP, BigQuery, Dataproc, and Apache Airflow
• Hands-on experience in developing, deploying, monitoring, and optimizing batch ETL workflows
• Good understanding of Medallion Architecture, data quality checks, and data summarization
• Experience in performance optimization, observability, and runbook creation
• Strong knowledge of Airflow orchestration, dependency handling, scheduling, and idempotent execution
• Exposure to Data Governance is an added advantage

Roles & Responsibilities

• Develop and maintain scalable ETL pipelines using Python and PySpark on GCP.
• Design and optimize batch data processing workflows using BigQuery, Dataproc, and Airflow.
• Implement data quality checks and performance optimization techniques.
• Monitor production pipelines, troubleshoot issues, and create operational runbooks.
• Collaborate with cross-functional teams to deliver reliable and scalable data solutions. Skills: gcp,airflow,dataproc,etl,python