Gcp Data Engineer

Job Requirements* We are seeking an experienced GCP Data Engineer to design, develop, and maintain scalable data solutions on the Google Cloud Platform (GCP). The ideal candidate will have strong expertise in building modern data pipelines, data warehousing, big data processing, and cloud-native analytics solutions. The role requires close collaboration with business stakeholders, data architects, data scientists, and application teams to deliver reliable and high-performance data platforms. Key Responsibilities* • Design, develop, and optimize scalable data pipelines using GCP services. • Build and maintain batch and real-time data ingestion and processing frameworks. • Ensure data quality, governance, security, and compliance across data platforms. • Develop enterprise-grade data warehousing solutions using BigQuery. • Implement ETL/ELT processes for structured and unstructured data. • Integrate data from multiple sources including databases, APIs, files, and streaming platforms. berribot jd version 3 • Optimize query performance, storage, and processing costs within GCP. • Automate deployment and operational processes using CI/CD and Infrastructure as Code (IaC). • Monitor data pipelines and troubleshoot production issues. • Mentor junior engineers and participate in technical design reviews. • Collaborate with Data Architects, Business Analysts, and Data Scientists to translate business requirements into technical solutions. • Implement data models, metadata management, and data lineage best practices. • Support migration of on-premise or multi-cloud data platforms to GCP. Required Technical Skills • Google Cloud Storage (GCS) • BigQuery • Cloud Composer (Apache Airflow) • Dataflow • Dataproc • Pub/Sub • Cloud Functions • Cloud Run • Cloud SQL • BigLake (preferred) • Vertex AI integration (good to have) • Python • SQL (Advanced) • PySpark Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using BigQuery, Cloud Storage, and Pub/Sub on Google Cloud Platform (GCP).
  
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
  
• Develop complex SQL queries to extract insights from massive datasets stored in BigQuery.
  
• Troubleshoot issues related to data processing, storage, and retrieval within the GCP ecosystem.
  
• Ensure scalability, reliability, and security of all GCP-based systems.