Big data hadoop admin

Key Responsibilities

• Install, configure, and manage HDP/CDP clusters in Linux environments.

• Perform Hadoop cluster administration, monitoring, and health checks.

• Manage HDFS storage, capacity planning, and space allocation.

• Configure and maintain NameNode High Availability (HA).

• Create, manage, and decommission cluster nodes as required.

• Deploy hardware, software, patches, and platform upgrades.

• Monitor cluster performance and perform tuning for optimal resource utilization.

• Manage HDFS file systems, permissions, quotas, and storage optimization.

• Troubleshoot Hadoop, Linux, infrastructure, and application-related issues.

• Configure and maintain security controls, including Kerberos authentication.

• Create and manage Linux users, groups, and Hadoop service accounts.

• Monitor and analyze logs to identify and resolve operational issues.

• Automate routine administrative activities using scripting and tools.

• Collaborate with infrastructure, application, network, database, and business teams to support platform operations.

• Maintain platform documentation and drive continuous improvement initiatives.

Required Technical Skills

• Strong hands-on experience with Hadoop and Big Data platforms.

• Expertise in Linux administration, preferably RHEL.

• Experience with Ambari and/or Cloudera Manager.

• Strong knowledge of HDFS administration, storage management, and performance optimization.

• Experience deploying, configuring, and maintaining Hadoop clusters.

• Good understanding of cluster resource management and scalability concepts.

• Knowledge of networking, infrastructure, and security fundamentals.

• Experience with Kerberos authentication and access management.

• Strong troubleshooting, monitoring, and performance tuning skills.

• Familiarity with patch management, software upgrades, and environment maintenance.

• Experience with Shell scripting, Python, or other automation tools.

• Strong analytical, problem-solving, and debugging capabilities.

Preferred Qualifications Experience

• Bachelors degree in Computer Science, Information Technology, Engineering, or a related field.

• 4-10 years of experience in Hadoop Administration, Big Data Operations, or Platform Support.

• Experience working with enterprise-scale Hadoop deployments.

• Exposure to cloud-based Big Data platforms is an added advantage.

• Hadoop, Cloudera, or Linux certifications preferred.

Key Competencies

• Strong ownership and operational excellence mindset.

• Effective communication and stakeholder management skills.

• Ability to work in a fast-paced production support environment.

• Strong collaboration and cross-functional coordination skills.

• Focus on reliability, scalability, security, and continuous improvement.