GCP Data Engineer

Job Summary


Responsibilities

• Design batch and real-time data pipelines.
• Develop scalable ETL/ELT pipelines using Dataflow, BigQuery and Composer.
• Ingest data from databases, APIs, files, SaaS applications and streaming sources.
• Design optimized BigQuery datasets, tables, partitioning and clustering.
• Build data transformations using SQL, Python, Beam, Spark or dbt/Dataform.
• Implement orchestration and dependency management using Airflow/Cloud Composer.
• Handle data quality, reconciliation, lineage and monitoring.
• Implement GCP security using IAM, service accounts and least-privilege access.
• Optimize BigQuery/Dataflow workloads for performance and cloud cost.
• Build infrastructure using Terraform and participate in CI/CD.
• Troubleshoot production data-pipeline failures.
• Work with Data Architects, Analysts, Data Scientists and application teams.

Job Details

• Role: GCP Data Engineer
• Location: Trivandrum/Kochi

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.