Google data Engineer

Greetings from Tata Consultancy Services !!!

GCP Data Engineer/Lead

Experience : 8 - 15 yrs

Data Engineer with GCP + Pyspark, Scala

1. Should know how to develop, deploy , monitor and optimize Etl workflows for batch with Scala, Pyspark, Airflow, BQ , Dataproc and GCP environments
2. Experience in Medallion architecture with proper Data quality checks and summarization activities
3. Experience in performance optimizations, Observability and runbook creations for continuous optimizations.
4. Good knowledge of Airflow orchestrations including dependency handing, idempotent execution etc.
5. Exposure to data governance would be a plus