Senior GCP BQ Data Engineer

Paragthi Enterprise (infosys Limited Jaipur, Pune) · Hyderabad · onsite · Posted 58d ago

Not disclosed8–12 yrsfulltimeSourced from Foundit

About a minute. You'll make an account on the way through.

About this role

Infosys is seeking an experienced Senior GCP Data Engineer with strong expertise in Google Cloud Platform GCP BigQuery Dataflow Apache Airflow Cloud Composer Cloud Spanner and cloud native data engineering solutions

Design develop and maintain enterprise scale data engineering solutions on Google Cloud Platform GCP
Build scalable ETL ELT pipelines using Dataflow Apache Beam BigQuery and Cloud Composer Airflow
Design and optimize BigQuery data warehouses for large scale analytics and reporting
Develop batch and real time data pipelines using Dataflow and GCP native services
Implement workflow orchestration using Apache Airflow Cloud Composer
Design and manage data models and schemas in Cloud Spanner and BigQuery environments
Integrate multiple data sources using GCP services such as Pub Sub Cloud Storage Cloud Functions and Dataflow
Monitor troubleshoot and optimize pipeline performance reliability and scalability
Collaborate with architects business stakeholders and development teams to deliver cloud data

8 to 12 years of experience in Data Engineering Big Data and Cloud Data Platforms
Strong hands on experience with Google Cloud Platform GCP
Expertise in BigQuery for data warehousing analytics and performance optimization
Strong experience with Dataflow and Apache Beam for large scale data processing
Experience with Apache Airflow and or Cloud Composer for workflow orchestration
Hands on experience with Cloud Spanner and distributed database concepts
Strong programming skills in Python and SQL
Experience building enterprise grade ETL ELT pipelines
Knowledge of Pub Sub Cloud Storage Cloud Functions and other GCP services
Strong understanding of data modeling performance tuning and data integration
Experience with version control systems such as Git
Knowledge of CI CD DevOps practices and Agile methodologies

Technology->Cloud Platform->GCP Core Services,Technology->Big Data->Big Table->GCP

Sourced from foundit

Cloud Storageapache airflowbigqueryCloud ComposerApache BeamCloud SpannerGoogle DataFlowGoogle Cloud FunctionsGoogle Cloud Pub SubPythonSQLGIT

About

Infosys Limited

Find them on

Key Responsibilities:

Design develop and maintain enterprise scale data engineering solutions on Google Cloud Platform GCP

Build scalable ETL ELT pipelines using Dataflow Apache Beam BigQuery and Cloud Composer Airflow

Design and optimize BigQuery data warehouses for large scale analytics and reporting

Develop batch and real time data pipelines using Dataflow and GCP native services

Implement workflow orchestration using Apache Airflow Cloud Composer

Design and manage data models and schemas in Cloud Spanner and BigQuery environments

Integrate multiple data sources using GCP services such as Pub Sub Cloud Storage Cloud Functions and Dataflow

Monitor troubleshoot and optimize pipeline performance reliability and scalability

Collaborate with architects business stakeholders and development teams to deliver cloud data

Technical Requirements:

8 to 12 years of experience in Data Engineering Big Data and Cloud Data Platforms

Strong hands on experience with Google Cloud Platform GCP

Expertise in BigQuery for data warehousing analytics and performance optimization

Strong experience with Dataflow and Apache Beam for large scale data processing

Experience with Apache Airflow and or Cloud Composer for workflow orchestration

Hands on experience with Cloud Spanner and distributed database concepts

Strong programming skills in Python and SQL

Experience building enterprise grade ETL ELT pipelines

Knowledge of Pub Sub Cloud Storage Cloud Functions and other GCP services

Strong understanding of data modeling performance tuning and data integration

Experience with version control systems such as Git

Knowledge of CI CD DevOps practices and Agile methodologies