Hadoop Production Support

Hadoop Production Support

Location: Hyderabad
Experience: 58 Years

Job Summary

We are looking for an experienced Hadoop Production Support Engineer to manage, monitor, and troubleshoot big data applications and Hadoop ecosystem components in a production environment.

Key Responsibilities

• Monitor and support Hadoop clusters and production data processing jobs.
• Troubleshoot production incidents, job failures, performance issues, and data processing errors.
• Work with Hadoop ecosystem components such as HDFS, YARN, Hive, Sqoop, and Spark.
• Monitor batch jobs and workflows using scheduling tools such as Oozie or similar tools.
• Perform root cause analysis (RCA) and ensure timely incident resolution.
• Write and execute SQL queries and Shell scripts for troubleshooting and automation.
• Handle incident, problem, and change management processes.
• Coordinate with development, infrastructure, and application teams to resolve production issues.
• Maintain support documentation, operational procedures, and incident reports.

Required Skills

• 5–8 years of experience in Hadoop or Big Data Production Support.
• Strong knowledge of Hadoop ecosystem components, especially HDFS, YARN, Hive, and Spark.
• Hands-on experience in production monitoring, troubleshooting, and incident management.
• Good working knowledge of Linux/Unix, Shell scripting, and SQL.
• Experience with batch processing, job scheduling, and log analysis.
• Knowledge of ITIL processes and SLA management.

Preferred Skills

• Experience with monitoring tools and job scheduling tools.
• Exposure to Kafka or other Big Data technologies.
• Experience with performance tuning and production support automation.