GCP - Data Engineer

Role Overview

We are looking for a Senior Data Engineer (GCP) with strong hands-on experience in building and optimizing scalable data pipelines on Google Cloud Platform. This role requires deep technical expertise in data engineering, pipeline development, and cloud-native solutions, with the ability to work closely with cross-functional teams to deliver high-quality data systems.

Key Responsibilities

• Design, build, and optimize scalable batch and real-time data pipelines.
• Develop and maintain ETL/ELT workflows for diverse data sources.
• Build robust data ingestion frameworks and support data migration initiatives.
• Manage workflow orchestration, scheduling, and pipeline dependencies.
• Ensure efficient and reliable data processing across environments.
• Optimize query performance and data processing jobs.
• Implement data validation, quality, and reconciliation frameworks.
• Monitor pipelines to ensure availability, reliability, and performance.
• Collaborate with cross-functional teams to translate business requirements into solutions.
• Contribute to data architecture and design discussions.
• Follow best practices for version control, CI/CD, and deployments.
• Ensure compliance with security, governance, and data standards.
• Support production systems through troubleshooting and continuous improvement.

Must-Have Skills

• 6-8 years of experience in data engineering.
• Strong hands-on experience with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage).
• Experience with Spark / PySpark and SQL optimization.
• Hands-on with Cloud Composer (Airflow).
• Strong understanding of data modeling and pipeline design.
• Experience with batch + streaming data processing.
• Familiarity with CI/CD and Git-based workflows.
• Strong problem-solving and analytical skills.