GCP Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Dataproc on GCP.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop complex queries in BigQuery to extract insights from massive datasets stored in Cloud Storage.
• Troubleshoot issues related to PubSub messaging queues and resolve them efficiently.

Job Requirements :

7+ years of total experience in data engineering, data platforms, or data-centric software engineering. 5+ years of hands-on experience designing and building data pipelines, ETL/ELT workflows, and cloud-native data solutions. 3+ years of direct experience with Google Cloud Platform (GCP) using services such as BigQuery, Cloud Storage, Cloud Run, Datafusion, Dataproc, Composer, and Pub/Sub. Advanced proficiency in SQL, Python, and PySpark for data processing and transformation. Proven experience developing and supporting production-grade, end-to-end cloud data pipelines. Expertise in ELT/ETL design, performance optimization, and data transformation frameworks. Strong background in monitoring, logging, alerting, and data quality frameworks across distributed systems. Experience with DevOps tools and techniques, including CI/CD, GitHub, and related automation practices. Demonstrated experience working in global, cross-functional, and agile development environments. Excellent communication, problem-solving, and analytical skills with the ability to collaborate across technical and non-technical teams. GCP certification preferred (e.g., Google Cloud Professional Data Engineer).