GCP Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Dataproc on GCP.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
• Develop complex ETL processes using PySpark and BigQuery to extract insights from massive datasets.
• Troubleshoot issues related to PubSub messaging queues and resolve them efficiently.

Job Requirements :

• 4-9 years of experience in Data Engineering with expertise in GCP technologies (Dataproc).
• Strong proficiency in Python programming language with experience working with libraries like Spark.
• Experience designing scalable architectures for big-data processing using PySpark and BigQuery.
• Knowledge of cloud-based messaging systems such as PubSub.