Data Engineer

Data Engineer Python | Spark | PySpark

Locations: Chennai / Bengaluru
Experience: 4-7 Years, 7-10 Years

Job Description

We are looking for experienced Data Engineers with strong hands-on expertise in Python, Apache Spark, and PySpark. The candidate will be responsible for developing and optimizing scalable data processing solutions and working on data engineering projects in a collaborative environment.

Key Responsibilities

• Develop and maintain scalable data pipelines using Python, Spark, and PySpark.
• Build and optimize data processing workflows using Apache Spark.
• Write efficient and reusable Python/PySpark code for large datasets.
• Perform data transformation, processing, validation, and troubleshooting.
• Collaborate with technical and business teams to understand data requirements.
• Optimize Spark jobs for performance and scalability.
• Follow coding, testing, and deployment best practices.

Mandatory Skills

• Python
• Apache Spark
• PySpark
• Strong Data Engineering experience with large datasets.
• Good understanding of data processing and transformation concepts.

Note: Candidates should be available for the F2F interview in Chennai or Bengaluru and should have strong hands-on experience in Python, Spark, and PySpark.