Pyspark Developer

Weekday walk in interview 22-Aug-2026

Skill: Python + Pyspark

Exp: 5+

Location:Chennai,Bangalore,Pune

Job Description:

We are looking for a skilled PySpark Developer with 5+ years of experience in designing, developing, and optimizing large-scale data processing applications. The ideal candidate should have strong hands-on expertise in PySpark, Python, SQL, and Data Engineering concepts, with experience building scalable ETL pipelines and processing large volumes of data. Relevant skills from enterprise JD templates include PySpark development, SQL, data warehousing, and cloud-based data engineering environments. [TCS_JD_Tem...Databricks | Word], [TCS_JD_Tem...Developer | Word], [TCS_JD_Tem...pr aws TRP | Word]

Must-Have Skills:

• Strong hands-on experience in PySpark
• Proficiency in Python Programming
• Strong SQL skills
• Experience in ETL/ELT development
• Knowledge of Data Warehousing concepts
• Experience with data modeling and large-scale data processing
• Understanding of Spark architecture and performance tuning
• Git/GitHub version control
• Strong debugging and troubleshooting skills

Good-to-Have Skills:

• AWS (S3, EMR, Glue)
• Databricks
• Airflow
• Snowflake
• dbt
• Redshift
• CI/CD pipelines
• Agile/Scrum methodology

Roles & Responsibilities:

• Develop and maintain scalable data pipelines using PySpark and Python.
• Design and implement ETL/ELT workflows for enterprise data platforms.
• Process and analyze large structured and unstructured datasets.
• Optimize Spark jobs for performance, scalability, and efficiency.
• Develop reusable frameworks and components for data processing.
• Collaborate with data architects, business analysts, and application teams.
• Perform data validation, reconciliation, and quality checks.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and follow coding best practices.

Relevant Experience:

• 5+ years of overall IT experience.
• Minimum 3 years of hands-on PySpark development experience.
• Experience in data engineering and data warehouse projects.
• Exposure to cloud-based data platforms is preferred. [TCS_JD_Tem...Databricks | Word], [TCS_JD_Tem...Developer | Word]

Education:

• BE / B.Tech / MCA / M.Tech or equivalent.