GCP + Big query (2-5)

We are looking for a talented GCP Data Engineer with 2-5 years of experience in designing, building, and maintaining scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate should have expertise in BigQuery, Dataflow, ETL/ELT processes, and cloud-based data warehousing solutions.

Key Responsibilities

• Design and develop scalable data pipelines using GCP services.
• Build and maintain ETL/ELT processes for structured and unstructured data.
• Develop and optimize data models and data warehouse solutions using BigQuery.
• Ingest data from various sources into GCP environments.
• Work with large-scale datasets and ensure data quality, integrity, and performance.
• Monitor, troubleshoot, and optimize data processing workflows.
• Collaborate with data analysts, data scientists, and business stakeholders.
• Implement data governance, security, and compliance best practices.
• Automate data workflows and deployments using CI/CD practices.

Required Skills

• 2-5 years of experience in Data Engineering.
• Strong experience with Google Cloud Platform (GCP).
• Hands-on experience with:
• BigQuery
• Dataflow
• Cloud Composer (Airflow)
• Pub/Sub
• Cloud Storage
• Dataproc
• Strong SQL skills and query optimization experience.
• Experience with Python, PySpark, or Java.
• Knowledge of ETL/ELT frameworks and data warehousing concepts.
• Experience working with batch and real-time data processing.
• Familiarity with Git and CI/CD tools.