Walk-in || Pyspark Data Engineer

Role/Skill: Pyspark Data Engineer

Experience: 4 to 15 Years

Walkin Location: Chennai

Walkin Drive Date: 19-Sep-26, Saturday

JD:

Responsibilities:

• Data Processing: Design, develop, and maintain data processing solutions using PySpark, Apache Spark, and Python.
• Data Pipeline Development: Develop and optimize data pipelines using PySpark, Apache Spark, and cloud-based data platforms.
• Data Integration: Integrate data from various sources, including relational databases, NoSQL databases, and cloud storage.
• Data Transformation: Develop and implement data transformation logic using PySpark, Apache Spark, and Python.

• PySpark: knowledge of PySpark, Apache Spark, and Python.
• Data Processing: understanding of data processing concepts, including data ingestion, data transformation, and data storage.
• Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.
• Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines