BENGALURU · FULLTIME
Consultant - GCP Data Engineer
Vivanti Consulting
Bengaluru · onsite · Posted 6d ago
Sourced from
Undisclosed6–11 yrsfulltimeBengaluru
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Job Summary
What You ll Get
What We re Looking For
What You ll Do
Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Your Career, Accelerated You ve got the skills. The curiosity. The hunger to grow, try new things and make a real impact. We re a growing global tech consultancy. Some of the world s biggest businesses turn to us to help bring their data, AI, cloud and digital solutions to life. We re the home base for talented technologists who want more and are looking to take their career to the next level by having more learning, more variety, more support and more chances to do meaningful work. If that sounds like the kind of place you d thrive in, keep reading.
What You ll Get
We know youre bringing the skills, the passion and the drive. What we bring is the platform to help you go further. At Vivanti, youre not just taking a job, youre investing in your growth. Heres a taste:
- A platform for growth: Work across industries, clients and technologies that stretch your thinking and build your personal and professional skills.
- Access global businesses: Work with some of the worlds biggest brands
- IP, frameworks and accelerators: We share what we know. Our playbooks and toolkits fast-track your success on projects.
- All the shiny tech: Databricks, Snowflake, Azure, GCP, AWS - you ll use it, play with it and maybe even break it (responsibly).
- Senior consultants who have your back: You ll always have a guide on your journey, not just be thrown into the deep end.
- Serious learning support: Paid certs, weekly training, guilds, hackathons, mentoring and more.
- Progress that s transparent: Annual reviews based on 360 feedback, not vague vibes. Clear goals, solid feedback and real growth.
- Kudos and rewards: We celebrate wins, reward impact and offer long-term incentives.
- Real connection: From Friday socials to annual team building days - we work hard and play harder.
What We re Looking For
We are looking for an accomplished and highly motivated Senior GCP Data Engineer to design, build, and optimize our Google Cloud Platform data architecture and pipelines. This expert will lead large-scale data solution implementation, ensure data quality, and promote engineering best practices.
- 6+ years of hands-on experience with Google Cloud Platform (GCP) data and analytics services.
- Experience using SQL, python or other relevant technology
- Core Services: BigQuery (expert level), Cloud Dataflow (Apache Beam), Cloud Storage.
- Processing: Dataproc (Apache Spark/Hadoop), Pub/Sub.
- Orchestration: Cloud Composer (Apache Airflow).
- Deep understanding of Data Warehousing, Data Lake concepts, and advanced data modeling techniques (Star/Snowflake schema, Data Vault).
- Experience with Infrastructure as Code (IaC) tools like Terraform or Cloud Deployment Manager.
- Strong knowledge of version control (Git), software development lifecycle, and Agile/Scrum methodologies.
What You ll Do
- Architect, design, and implement robust, scalable, and fault-tolerant data ingestion and ETL/ELT pipelines for batch and real-time processing on GCP.
- Define and enforce data modeling standards (Dimensional, 3NF, Data Vault, etc.) for optimal performance in BigQuery and other storage solutions.
- Lead the technical design and deployment of Data Lakes and Data Warehouses using best-in-class GCP services.
- Develop and maintain complex data pipelines using Python (Pandas, PySpark) and/or Scala/Java with a strong focus on Apache Beam/Dataflow and Dataproc/Spark.
- Write, optimize, and tune advanced SQL queries for efficiency and cost reduction, particularly within BigQuery.
- Implement data orchestration and workflow management using Cloud Composer (Apache Airflow).
- Ensure optimal performance, cost efficiency, and reliability of all data solutions through continuous monitoring and tuning.
- Implement data governance and data quality frameworks, including data validation, lineage tracking, and metadata management (e.g., Data Catalog).
- Establish and enforce security best practices on GCP, including IAM, data encryption (at rest and in transit), and proper network access controls.
- Drive DevOps principles: implement and maintain CI/CD pipelines for data solutions using tools like Cloud Build, Jenkins, or GitLab.
Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
AgileApache SparkCloud DeploymentCI/CD PipelinesApacheadvanced sqlamazon web servicesCloud Storageapache airflowArticulatebigqueryCost ReductionCloud ComposerAnalyticsApache BeamcloudArchitectureMicrosoft AzureGoogle ComposerArtificial Intelligence