Full Stack Data Engineer

Job Description

• We’re seeking a Data Engineer who has experience building data products on a cloud analytics platform.
• You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise Data Platform on Google Cloud Platform (GCP).
• Experience with large scale solution and operationalization of data lakes, data warehouses, and analytics platforms on Google Cloud Platform or other cloud environments is a must.

Good To Have Skills

• In-depth understanding of Google’s product technology (or other cloud platform) and underlying architectures especially Gen AI /Ford LLM
• Experience in working with DBT/Dataform.
• Experience with DataPlex or other data catalogs.
• Experience with development eco-system such as Tekton, Git, Jenkins for CI/CD pipelines.
• Experience in working with Agile and Lean methodologies.
• Experience with performance tuning SQL queries.
• Experience in creating and executing detailed test plans.
• GCP Professional Data Engineer Certified
• Master’s degree in computer science or related field

Responsibilities What you'll do...

• Work on a Central Engineering Portfolio Team based in Chennai to deliver curated data products and perform end to end Full stack Data engineer role.
• Work effectively with fellow data engineers, product owners, data champions and other technical experts.
• Demonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutions.
• Develop exceptional analytical data products using both streaming and batch ingestion patterns on Google Cloud Platform with solid data warehouse principles.
• Be the Subject Matter Expert in Data Engineering with a focus on GCP native services and other well integrated third-party technologies.

Required Qualifications

• 5+ years of SQL development and analytics/data product development experience.
• 3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale.
• Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.
• Experience working with Airflow for scheduling and orchestration of data pipelines.
• Experience working with Terraform to provision Infrastructure as Code.
• 2 + years professional development experience in Java or Python.
• Bachelor’s degree in computer science or related scientific field.
• Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products.
• Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumption.
• Experience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management.