Data Engineer (GCP)

Responsibilities:

• Design, build, and deploy internal applications to support our technology life cycle, collaboration and spaces, service delivery management, and data and business intelligence, among others.
• Build modular code for a reusable pipeline or any kind of complex ingestion framework used to ease the job of loading data into the Data Lake or Data Warehouse from multiple sources.
• Work closely with analysts and business process owners to translate business requirements into technical solutions.
• Coding experience in scripting and languages (Python, SQL, PySpark).
• Maintain the highest levels of development practices, including technical design, solution development, systems configuration, test documentation/execution, issue identification and resolution, and writing clean, modular, and self-sustaining code, with repeatable quality and predictability.

Requirements:

• 5+ years of industry experience in software development, data engineering, business intelligence, or a related field with experience in manipulating, processing, and extracting value from datasets.
• Expertise in Google Cloud Platform (GCP) technologies in the data warehousing space (BigQuery, Dataproc, GCP Workflows, Dataflow, Cloud Scheduler, Secret Manager, Batch, Cloud Logging, Cloud SDK, Google Cloud Storage, IAM, and Vertex AI).
• Understanding CI/CD processes using Pulumi, GitHub, Cloud Build, Cloud SDK, and Docker.
• Experience with SQL Server/SSIS is an added advantage.