Sr Consultant - Business Consulting Risk - GCP Data Engineer

Job Summary

The opportunity: Senior Consultant-FS-Business Consulting - GCP Data Engineer-Pyspark - FSRM - Pune, Hyderabad

GCP Data Engineer role overview: We are seeking a highly skilled GCP Data Engineer with 5+ years of experience in designing, developing, and maintaining large-scale data pipelines on Google Cloud Platform (GCP). The ideal candidate should have strong hands-on expertise in PySpark, distributed data processing, ETL development, and cloud-native data engineering solutions. The candidate will be responsible for building scalable data pipelines, optimizing data workflows, and enabling reliable data delivery for analytics and business intelligence initiatives.

Your key responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and GCP services.
• Build and optimize ETL/ELT processes for processing large volumes of structured and unstructured data.
• Work with GCP services such as BigQuery, Dataproc, Cloud Storage, Dataflow, Pub/Sub, Composer, and Cloud Functions.
• Perform data ingestion, transformation, cleansing, and validation activities.
• Collaborate with business, analytics, and engineering teams to understand data requirements and deliver robust solutions.
• Implement performance tuning, monitoring, and troubleshooting of data pipelines.
• Ensure data quality, governance, security, and compliance standards are met.
• Participate in Agile development practices, code reviews, and CI/CD implementation.

Required Skills

• 5+ years of Data Engineering experience.
• Strong hands-on expertise in Python and PySpark.
• Experience with Google Cloud Platform (GCP) services, especially BigQuery, Dataproc, Cloud Storage, Dataflow, and Pub/Sub.
• Strong SQL skills and experience with large-scale data processing.
• Knowledge of ETL frameworks, data modeling, and data warehousing concepts.
• Experience with Git, Jenkins/GitHub Actions, and CI/CD pipelines.
• Excellent problem-solving and stakeholder communication skills

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.