GCP Data Engineer

About Position:

We are seeking a motivated and skilled Data Engineer with hands-on experience in Google Cloud Platform (GCP) and strong Python development expertise. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines, enabling reliable data integration, and supporting data-driven decision-making across the organization. This role requires strong technical capabilities in cloud-based data engineering, ETL/ELT development, orchestration frameworks, and database technologies along with the ability to work independently in a collaborative and asynchronous environment.

• Role: GCP Data Engineer
• Location: All Persistent Locations
• Experience: Between 3 to 5 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain scalable data pipelines using Google Cloud Platform services.
• Build and optimize data ingestion, transformation, and processing workflows using Python and SQL.
• Develop and manage data solutions leveraging BigQuery, Cloud Storage, and other GCP services.
• Create high-performance data models and datasets to support analytics and reporting requirements.
• Optimize SQL queries and data processing jobs using partitioning, clustering, window functions, and Common Table Expressions (CTEs).
• Develop and maintain data transformation frameworks using dbt Core or dbt Cloud.
• Implement and manage workflow orchestration using Prefect, Airflow, or Cloud Composer.
• Develop REST API integrations using Python, including pagination handling, JSON processing, authentication, and error management.
• Configure and manage IAM roles, service accounts, and security controls within GCP environments.
• Utilize Terraform to provision and manage cloud infrastructure as code.
• Collaborate with business stakeholders, analysts, and engineering teams to understand data requirements and deliver reliable solutions.
• Monitor pipeline performance, troubleshoot production issues, and implement improvements for reliability and scalability.
• Maintain code repositories using GitHub and follow established branching, merge request, and version control practices.
• Ensure data quality, integrity, governance, and compliance across data pipelines and platforms.
• Create and maintain technical documentation, data flow diagrams, and operational runbooks.
• Participate in code reviews and contribute to continuous improvement initiatives across the data engineering team.

Expertise You'll Bring:

• 3 to 5 years of experience in Data Engineering, ETL Development, or Cloud Data Platform implementation.
• Strong hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Storage, IAM, and Service Accounts.
• Proficiency in Python for data engineering, automation, and REST API integrations.
• Experience building and managing data pipelines using modern ETL/ELT methodologies.
• Strong expertise in SQL, including advanced query optimization, window functions, joins, aggregations, and CTEs.
• Hands-on experience with dbt (Core or Cloud) for data transformation and modeling.
• Experience with orchestration tools such as Prefect, Apache Airflow, or Cloud Composer.
• Strong understanding of data warehousing concepts, dimensional modeling, and large-scale data processing.
• Experience with GitHub and version control best practices.
• Knowledge of Infrastructure as Code (IaC) using Terraform.
• Understanding of data governance, data quality frameworks, and security best practices.
• Experience working with structured, semi-structured, and unstructured datasets.
• Strong analytical, problem-solving, and debugging skills.
• Ability to work independently and effectively in an asynchronous work environment.
• Excellent communication and documentation skills.
• Strong commitment to quality, continuous learning, and engineering excellence.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.