Gcp Data Engineer

Key Responsibilities

• Data Pipeline Development: Build robust ETL/ELT data ingestion and transformation pipelines using Cloud Dataflow, Pub/Sub, and Apache Beam.
• Data Warehousing: Design and optimize large-scale analytical data stores using BigQuery and Cloud Storage.
• Workflow Orchestration: Automate and schedule data workflows using Cloud Composer (managed Apache Airflow).
• Data Quality & Governance: Implement monitoring, data validation, and security protocols via Identity and Access Management (IAM).
• Collaboration: Work with data scientists, analysts, and product managers to scale data architectures.

Required Skills & Qualifications

• Core Languages: Advanced SQL and strong programming proficiency in Python, Java, or Scala.
• GCP Ecosystem: Hands-on experience with BigQuery, Dataflow, Dataproc, Cloud SQL, and Pub/Sub.
• Big Data Frameworks: Knowledge of distributed computing, Apache Spark, or Apache Airflow.
• Data Modeling: Understanding of dimensional modeling, star schemas, and data warehousing concepts.