Pyspark Developer (5 locations)

TCS Hiring for Pyspark Developer

Experience Range: - 05 To 10 Years (Mandatory)

(Note: Candidates below 5 years of IT experience shall not be considered)

Job Locations : Bengaluru, Chennai, Hyderabad, Pune, Kolkata

JOB DESCRIPTION

Job Requirements:

• Experience with strong proficiency in Python and PySpark.
• Experience working on Spark SQL, RDD, and DataFrame APIs.
• Good understanding of Hadoop ecosystem (Hive, HDFS, YARN).
• Knowledge of data formats like Parquet, Avro, JSON, etc.
• Experience with SQL and writing efficient queries.
• Familiarity with job orchestration tools (Airflow, Oozie, or similar).
• Version control systems like Git.
• Exposure to cloud platforms (AWS/GCP/Azure) is a plus.

Key responsibilities:

• Design, develop, and maintain robust ETL/ELT pipelines using PySpark and other big data technologies. Optimize Spark jobs for performance and scalability.
• Implement data transformations, aggregations, and joins over large datasets. Perform batch and real-time data processing tasks.
• Collaborate with data scientists, analysts, and other engineers to understand requirements and deliver quality solutions. Integrate PySpark solutions with data warehouses (like Hive, Redshift, Snowflake) and other data stores.
• Write clean, maintainable, and well-documented code. Follow version control and CI/CD practices using tools like Git, Jenkins, or Azure DevOps.
• Troubleshoot data quality and performance issues. Monitor pipeline health and ensure SLAs are met.
• Work with tools and platforms like Hadoop, Hive, HDFS, AWS EMR, Databricks, or Azure Synapse as required.

Minimum Qualification:

15 years of Full Time Education

Interested candidates kindly share your updated resume to [HIDDEN TEXT] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:

Section 1: Basic Details:

• Candidate Name:
• Email ID:
• Phone Number:
• Current Location (City):
• Preferred Location (City):

Section 2: Educational Details:

• Highest Regular Full‑Time Qualification
• (Diploma / Graduation / Post Graduation / Others)
• 10th Completion Year
• 12th / Intermediate Completion Year
• Graduation Completion Year
• Post‑Graduation Completion Year (if applicable)

Section 3: Work Experience:

• Current Company Name
• Total Experience (in years)
• Number of Companies Worked
• Employment Timeline
• (Example: Company A – 2021 to Present, Company B – 2019 to 2021)

Section 4: Compensation Details:

• Current CTC (in LPA)
• Expected CTC (in LPA)
• Notice Period
• (Immediate / 15 Days / 30 Days / 60+ Days)

Section 5: Documentation & Compliance (Yes / No):

• Valid ID Proof Available (Aadhar & Pan Card): (Yes/No)
• Educational Documents Available: (Yes/No)
• Employment Documents Available: (Yes/No)
• UAN Number Available: (Yes/No)