Big Data Hadoop Developer

Big Data Hadoop Developer

Experience: 512 Years
Location: Bangalore
Role: Big Data / Hadoop Developer

Job Summary

We are looking for an experienced Big Data Hadoop Developer with 5–12 years of experience in designing, developing, and optimizing large-scale data processing solutions. The candidate should have strong hands-on experience with the Hadoop ecosystem, data processing, ETL, SQL, and distributed computing.

Key Responsibilities

• Design, develop, and maintain scalable Big Data processing solutions.
• Work with Hadoop ecosystem technologies for processing and managing large datasets.
• Develop and optimize data pipelines for structured and unstructured data.
• Perform data extraction, transformation, cleansing, and loading.
• Develop complex SQL queries for data processing and validation.
• Work with distributed data processing frameworks and optimize jobs for performance.
• Troubleshoot data pipeline failures and production issues.
• Analyze data requirements and translate them into technical solutions.
• Collaborate with Data Engineers, Data Architects, Analysts, and business stakeholders.
• Ensure data pipelines are reliable, scalable, and maintainable.
• Perform data validation and reconciliation.
• Maintain technical documentation for data pipelines and processes.

Required Skills

• 5–12 years of experience in Big Data / Data Engineering.
• Strong hands-on experience with Hadoop.
• Good knowledge of HDFS, Hive, and MapReduce.
• Experience with Apache Spark / PySpark.
• Strong SQL skills.
• Experience with ETL/data pipeline development.
• Good understanding of distributed computing and Big Data architecture.
• Experience working with large datasets.
• Strong debugging and performance-tuning skills.
• Good analytical and problem-solving abilities.

Good to Have

• Kafka
• Scala / Python
• HBase
• Sqoop
• Oozie
• Databricks
• Airflow
• Cloud platforms – AWS / Azure / GCP

Key Skills

Hadoop | HDFS | Hive | Spark | PySpark | Big Data | SQL | ETL | Data Engineering | Kafka | Data Processing