Tcs Pune Walk-In-Drive GCP Data Engineer ( 5 To 12 yrs)

Role & responsibilities

Data modelling/Data warehouse modernization/Cloud based data lakes

Create and maintain optimal data pipeline architecture

Define technical roadmap for data platform modernization and analysis and assessment of the existing data platforms

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Google cloud big data technologies.

Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Define KPIs for successful modernization of data platform and measure the improvement against the KPIs.

Preferred candidate profile

Must-Have

• Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on experience)
• Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc.
• Good skills in Python Language, PYSPARK
• Good Skills in Linux
• Exposure to creation of CI-CD pipelines for promoting big data release deployments and designing log monitoring features.
• Excellent written and verbal communication skills in English
• The following skills are good-to-have, but not a requirement:

Good-to-Have

• Experience in On Premise Hadoop technologies (Hive, Sqoop, SPARK, Kafka)

Hadoop, Spark, Apache Beam