Senior Pyspark Developer
Luxoft · Chennai · onsite · Posted 44d ago
Undisclosed5–10 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
We are looking for a skilled Senior Pyspark Developer with 5 to 10 years of experience. The job location is flexible.
Role and Responsibilities - Design, develop, and deploy scalable data processing pipelines using Pyspark.
- Collaborate with cross-functional teams to identify and prioritize project requirements.
- Develop and maintain large-scale data warehouses and data lakes using Hadoop technologies.
- Optimize data processing workflows for performance, scalability, and reliability.
- Troubleshoot and resolve complex technical issues in the development environment.
- Participate in code reviews and contribute to improving overall code quality.
- Strong proficiency in Python programming language and its ecosystem.
- Experience with big data processing frameworks such as Hadoop and Spark.
- Knowledge of database management systems such as MySQL or NoSQL databases like MongoDB.
- Familiarity with cloud-based platforms such as AWS or Azure.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
Sourced from naukri
Skills
CalculationApache SparkScalaHiveHdfsamazon web servicesNatural Language Processingsqoopprocess engineeringoozieApache HadoopPysparkPythonMySQLSQLJavaETLMicrosoft AzureBig DataData ScienceMachine Learning
About Luxoft
Luxoft
IT Services & Consulting
2.3k+
employees
2000
26 years old
Zug, Switzerland
Switzerland
About
Luxoft offers the full spectrum of enterprise technology services, from modernizing legacy IT systems to delivering digital transformation at scale.
Industries
IT Services & Consulting
Employee ratings
832 reviews
3.6/ 5
Culture
3.6
Career growth
2.7
Work-life
3.9
Employees rate it well for
Work Life Balance165Salary128Senior Management87Work Culture76Appraisal64
Find them on