Bigdata Application Support - Chennai/ Bangalore

Role Overview

We are looking for a Python / Spark Data Engineer with strong hands-on experience in Spark-based data processing, production support, troubleshooting, and batch processing. The candidate should have exposure to modern data platforms and orchestration technologies, with the ability to debug and support data-processing applications in production environments.

Key Responsibilities

• Develop, support, troubleshoot, and debug Python and Spark-based data processing jobs.
• Provide production/application support for data engineering applications and batch processes.
• Monitor and support batch-processing workflows and resolve production issues.
• Work with Spark, Hive, and Data Warehouse load processes.
• Perform scheduling and batch orchestration using tools such as Airflow and Oozie.
• Work with Databricks and cloud-based data environments.
• Support data pipelines involving Kafka and related processes.
• Troubleshoot application and data-processing issues and perform root-cause analysis.
• Coordinate with users and relevant teams for timely resolution of production issues.
• Willing to work in 24/7 Shifts including night shifts

Required Technical Skills

• Python
• Apache Spark / PySpark
• Databricks
• Hive / Data Warehousing
• Kafka
• Airflow / Oozie
• Batch Processing & Scheduling
• Production / Application Support
• Troubleshooting & Debugging
• Cloud environment exposure