HYDERABAD · FULLTIME
Python-Pyspark Developer
Paragthi Enterprise (infosys Limited Jaipur, Pune)
Hyderabad · onsite · Posted 44d ago
Sourced from
Undisclosed5–9 yrsfulltimeHyderabad
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.2s
- Found the form on Naukri · 14 questions to answer1.6s
- Decided the answers for all of them2.9s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Educational Requirements
- Bachelor of Engineering
- BTech
- BCA
- BSc
- MTech
- MSc
- MCA
Data Analytics Unit
Responsibilities - We are looking for an experienced Python PySpark Developer to design, develop, and optimize large-scale data processing systems.
- The ideal candidate will work on big data platforms, build scalable ETL pipelines, and process high-volume datasets using Spark and Python.
- Develop and maintain data pipelines using Python and PySpark.
- Process and transform large datasets in distributed environments.
- Build scalable ETL/ELT workflows.
- Work with Apache Spark (PySpark) for batch and real-time processing.
- Optimize Spark jobs for performance and efficiency.
- Handle structured and unstructured data.
- Ingest data from multiple sources: Databases (SQL/NoSQL), APIs, Files (CSV, JSON, Parquet).
- Integrate with data platforms like Hadoop (HDFS) and Cloud (AWS, Azure, GCP).
- Tune Spark jobs (partitioning, caching, parallelism).
- Optimize SQL queries and transformations.
- Improve data processing efficiency and cost.
- Collaborate with data engineers, data scientists, and analysts.
- Translate business requirements into technical solutions.
- Participate in code reviews and agile development practices.
- Debug and resolve issues in data pipelines.
- Monitor job execution and data quality.
- Ensure reliability and availability of data workflows.
- Primary skills: Python, PySpark
- OpenSystem
- Python
- PySpark
- Big Data
- Data Processing
Sourced from naukri
Section · 02
Skills
CalculationApache SparkScalaHiveHdfsamazon web servicesNatural Language Processingsqoopprocess engineeringoozieApache HadoopPysparkPythonMySQLSQLJavaETLMicrosoft AzureBig DataData ScienceMachine Learning
Section · Company
About Paragthi Enterprise (infosys Limited Jaipur, Pune)
Paragthi Enterprise (infosys Limited Jaipur, Pune)
About
Infosys Limited
Find them on