GCP Data Architect

Role

GCP Data Architect

Required Technical Skill Set

Google Cloud Platform (GCP) services. Strong hands-on experience with BigQuery Pub/Sub, data pipelines (batch and streaming) with Dataflow/Dataproc/Spark, SQL and Python

Desired Experience Range

10-15 yrs

Location of Requirement 

Chennai/Hyderabad/Bangalore/Pune/Kochi

Desired Competencies

Must-Have

• Strong hands-on experience with BigQuery Pub/Sub, Python, data pipelines (batch and streaming) with Dataflow/Dataproc/Spark
• Proficiency in SQL
• Serverless Computing:Leverage GCP's serverless offerings such as Cloud Functions, App Engine, and Cloud Run.
• Infrastructure as Code (IaC):Develop and manage Terraform scripts for provisioning and managing GCP infrastructure, ensuring repeatability and consistency in deployments.
• Memory Management: Optimizethe performance of applications and systems through effective memory management strategies, ensuring efficient resourceutilization.
• Data Integration and Messaging:Design and implement messaging and event-driven architectures using Pub/Sub and other GCP services for real-time data processing and integration.
• Python Scripting:Write andmaintainPython scripts for automation tasks, custom solutions, and integration with GCP APIs.
• Best Practices and Governance: Establishand enforce best practices for cloud architecture, including security, cost management, and compliance. Implement governance models to ensure consistent cloud operations.
• Training and Mentorship:Provide training, guidance, and mentorship to internal teams and customers on GCP services and best practices.
• Troubleshooting and Support:Act as an escalation point for complex technical issues, providing hands-on support and guidance to resolve critical cloud-related challenges.

Good-to-Have

• Proven experienceas aCloudprojectswith a focus on Google Cloud Platform (GCP).
• Deep knowledgeof GCP services, including but not limited to Compute Engine, App Engine, Cloud Functions, Pub/Sub, VPCs, Cloud Storage, andBigQuery.
• Strong understandingof networking concepts, including DNS, VPN, firewalls, and load balancing.
• Expertisein Terraformfor infrastructure as code (IaC) deployments on GCP.
• Proficiencyin Python scriptingfor automation and custom solution development.
• Experience with serverless computingand designing event-driven architectures.
• Familiarity with memory managementtechniques in cloud environments.
• Excellent communication skillsto interact with customers, understand their needs, and deliver clear, actionable advice.
• Strong problem-solving skillswith the ability to troubleshoot complex issues in a cloud environment.
• Certification in Google Cloud(e.g.,ACE andProfessionalData Engineer) ismust.

SN

Role descriptions / Expectations from the Role 

1

• Own end-to-end data architecture on GCP, including reference architectures, standards, patterns, and roadmaps.
• Design batch and streaming ingestion using Pub/Sub, Dataflow, Dataproc, Transfer Service, and partner tools; define schemas and contracts.
• Serverless Computing:Leverage GCP's serverless offerings such as Cloud Functions, App Engine, and Cloud Run.
• Infrastructure as Code (IaC):Develop and manage Terraform scripts for provisioning and managing GCP infrastructure, ensuring repeatability and consistency in deployments.
• Memory Management: Optimizethe performance of applications and systems through effective memory management strategies, ensuring efficient resourceutilization.
• Data Integration and Messaging:Design and implement messaging and event-driven architectures using Pub/Sub and other GCP services for real-time data processing and integration.
• Python Scripting:Write andmaintainPython scripts for automation tasks, custom solutions, and integration with GCP APIs.
• Best Practices and Governance: Establishand enforce best practices for cloud architecture, including security, cost management, and compliance. Implement governance models to ensure consistent cloud operations.
• Training and Mentorship:Provide training, guidance, and mentorship to internal teams and customers on GCP services and best practices.
• Troubleshooting and Support:Act as an escalation point for complex technical issues, providing hands-on support and guidance to resolve critical cloud-related challenges.