SENIOR ENGINEER - Data Management/Mining/Collection

Job Title: Platform Engineer Unified Data Platform (UDP)

Years of Experience: 3-5 Years

Job Summary: We are seeking a skilled Platform Engineer to join our team and contribute to the design, build, and operation of our Unified Data Platform (UDP) on Google Cloud Platform. The ideal candidate will have a strong background in Infrastructure as Code and automation principles, with a focus on data management, mining, and collection. This role is critical in ensuring the scalability, resilience, and cost efficiency of our data platform across various environments.

Responsibilities

• Design, build, and operate the Unified Data Platform (UDP) infrastructure using Infrastructure as Code and automation first principles on Google Cloud Platform.
• Engineer and maintain standardized data platform components, including:
• Cloud landing zones for data workloads.
• Compute, storage, and networking for data processing.
• Secure connectivity between source systems and the data platform.
• Ensure platform scalability, resilience, and cost efficiency across development, testing, and production environments.
• Collaborate with cross-functional teams to gather requirements and implement solutions that meet business needs.
• Monitor and optimize platform performance, ensuring high availability and reliability.
• Document processes, configurations, and best practices for platform management.
• Stay updated with industry trends and emerging technologies to continuously improve the platform.
  

Mandatory Skills

• Proven experience in data management, mining, and collection.
• Strong proficiency in Infrastructure as Code (IaC) tools such as Terraform or CloudFormation.
• Hands-on experience with Google Cloud Platform services, including but not limited to BigQuery, Cloud Storage, and Compute Engine.
• Solid understanding of networking concepts and secure connectivity practices.
• Experience with CI/CD pipelines and automation tools.
  
  

Preferred Skills

• Familiarity with containerization technologies such as Docker and Kubernetes.
• Knowledge of data processing frameworks like Apache Spark or Apache Beam.
• Experience with monitoring and logging tools such as Stackdriver or Prometheus.
• Understanding of data governance and compliance standards.
  
  

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 3-5 years of experience in platform engineering or a related role.
• Strong problem-solving skills and the ability to work independently as well as part of a team.
• Excellent communication skills, both verbal and written.
  
  

If you are passionate about building robust data platforms and have the required skills and experience, we encourage you to apply and join our innovative team.

Data Governance, Data Quality