GCP Data Engineer

Data Engineer – GCP

Experience: 5–8 years

Location: Bangalore

Employment Type: Full-time

Role Overview

We are looking for an experienced GCP Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions. The candidate should have strong hands-on experience with GCP data services, ETL/ELT development, SQL, and Python.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines on Google Cloud Platform.
• Build and maintain data pipelines using Cloud Dataflow, Dataproc, Cloud Composer, and BigQuery.
• Develop complex SQL queries and optimize BigQuery performance.
• Develop data processing solutions using Python and PySpark.
• Work with GCS, BigQuery, Pub/Sub, Dataflow, Dataproc, and Cloud Composer.
• Implement data ingestion from databases, APIs, files, and other sources.
• Develop data models and support data warehouse/lakehouse solutions.
• Implement data quality, validation, monitoring, and error-handling mechanisms.
• Optimize pipeline performance and cloud resource utilization.
• Collaborate with data architects, analysts, developers, and business stakeholders.
• Follow security, governance, and CI/CD best practices.

Required Skills

• Strong hands-on experience with GCP data engineering services.
• Good knowledge of BigQuery, GCS, Dataflow, Dataproc, and Cloud Composer.
• Strong SQL and Python skills.
• Experience with PySpark and distributed data processing.
• Strong understanding of ETL/ELT concepts and data warehousing.
• Experience working with batch and/or real-time data pipelines.
• Knowledge of Git and CI/CD tools.
• Good understanding of data modeling, partitioning, and performance optimization.