Platform Engineer - Kubernetes & Data Platform

Are you a Platform Engineer passionate about Kubernetes and Data Engineering Torry Harris is looking for a skilled Platform Engineer to join our team and help build a next-generation, on-premises Kubernetes Data Platform powering large-scale data processing, AI/ML workloads, real-time analytics, and self-service data capabilities.

As a Platform Engineer, you will design, build, automate, operate, and scale the platform using Kubernetes, Stackable Data Platform, Apache Spark, Apache Kafka, Apache NiFi, and S3-compatible Object Storage. You ll work closely with Platform and Data Engineering teams to build a secure, resilient, scalable, and multi-tenant platform that enables strategic data initiatives.

- Design, build, and operate production-grade, on-premises Kubernetes platforms for data-intensive and AI/ML workloads.

- Deploy, manage, and optimize Stackable Data Platform, Apache Spark, Apache Kafka, Apache NiFi, and S3-compatible Object Storage on Kubernetes.

- Build scalable, resilient, secure, and multi-tenant platform architectures with self-service capabilities for Data Engineering and AI/ML teams.

- Implement GitOps and automation using Argo CD, Helm, Infrastructure as Code, and CI/CD pipelines for platform provisioning, deployment, upgrades, and lifecycle management.

- Enable data lake, real-time analytics, AI/ML use cases, and migration of workloads from legacy Hadoop to Kubernetes-native platforms.

- Establish platform monitoring, observability, alerting, capacity management, backup, and disaster recovery practices.

- Troubleshoot complex production issues, lead Root Cause Analysis (RCA), and drive continuous improvements in platform reliability and performance.

- Implement Kubernetes security, RBAC, secrets, certificates, network policies, governance, and compliance controls.

- Collaborate with Platform, Data Engineering, AI/ML, Infrastructure, and Security teams to deliver strategic Data Platform initiatives and engineering best practices.