Data Engineer | Python | Pyspark | Airflow | F2F | 4+ Years | Only Immediate Joiners

Data Engineer – Python & PySpark

Must-Have Skills: Python, PySpark, Iceberg / Airflow

Location: Bangalore / Chennai

Job Summary:

We are looking for a skilled Data Engineer with experience in Python, PySpark, and Apache Iceberg or Airflow to develop, maintain, and optimize data pipelines.

Key Responsibilities:

• Develop and maintain data pipelines using Python and PySpark.
• Work with large datasets and distributed data processing.
• Implement and manage data workflows using Apache Airflow.
• Work with Apache Iceberg for data storage and table management.
• Troubleshoot pipeline failures and optimize data processing performance.
• Ensure data quality, reliability, and consistency.

Required Skills:

• Strong experience in Python and PySpark.
• Hands-on experience with Apache Iceberg and/or Apache Airflow.
• Understanding of data engineering concepts and ETL/ELT pipelines.
• Knowledge of SQL and data processing frameworks.
• Strong problem-solving and debugging skills.

Job Locations: Bangalore / Chennai