Cloudera Platform Engineer

Job Title: Cloudera Platform Engineer / CDP Administrator
Experience: 5+ Years
Location: India (Hybrid)
Domain: Data & Technology Platforms

Job Summary

We are looking for an experienced Cloudera Platform Engineer with strong hands-on production support and administration experience in Cloudera Data Platform (CDP). The ideal candidate will have expertise in CDP installation, maintenance, security implementation, cluster optimization, automation, containerization, CI/CD practices, and troubleshooting big data workloads across enterprise environments.

Key Responsibilities

• Install, configure, upgrade, and maintain Cloudera Data Platform (CDP) environments.
• Manage and support CDP 7.1.9 or latest CDP versions across development, testing, and production environments.
• Implement and maintain security configurations, governance controls, and compliance requirements within CDP.
• Monitor and optimize Hadoop/Spark ecosystem performance, ensuring high availability and reliability.
• Troubleshoot and resolve issues related to:
• Spark Jobs
• Hive Queries
• YARN Applications
• Cluster Performance
• Collaborate with Data Engineers to optimize Spark workloads and improve processing efficiency.
• Manage and support Cloudera Data Services (CDS) 1.5.4 and 1.5.5.
• Build automation solutions using Ansible, Shell Scripting, Python, Terraform, and Groovy.
• Develop and maintain CI/CD pipelines for data and analytics platforms.
• Implement observability, monitoring, logging, and alerting solutions.
• Perform automated patching, security validation, and regulatory compliance checks.
• Support containerized deployments using Docker, Podman, Kubernetes, and OpenShift.
• Participate in Agile ceremonies and contribute to continuous improvement initiatives.

Required Skills

Cloudera & Big Data

• Cloudera Data Platform (CDP) Administration
• Hadoop Ecosystem Administration
• Cloudera Data Services (CDS)
• Spark Performance Tuning
• Hive & YARN Administration
• Cluster Optimization & Maintenance
• CDP Security & Governance

Automation & DevOps

• Ansible
• Terraform
• Shell Scripting
• Groovy
• Python
• Git/GitHub

CI/CD & Deployment

• Jenkins
• GitHub Actions
• ArgoCD
• CI/CD Pipeline Management

Containerization & Orchestration

• Docker
• Podman
• Kubernetes
• OpenShift (OCP)

Operating Systems

• Linux Administration
• Networking Concepts
• System Monitoring & Observability

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Minimum 5+ years of hands-on experience in Cloudera/Hadoop production environments.
• Experience managing large-scale enterprise data platforms.
• Strong troubleshooting and problem-solving abilities.
• Good communication and stakeholder management skills.

Preferred Qualifications

• Exposure to Public Cloud platforms (AWS, Azure, GCP).
• Experience supporting Data Science or Machine Learning platforms.
• Knowledge of modern DataOps and Platform Engineering practices.
• Certifications related to Cloudera, Hadoop, Kubernetes, or Cloud technologies.