Lead Pyspark Developer

We are looking for a skilled Lead Pyspark Developer with 5 to 10 years of experience to join our team at Luxoft India LLP. The ideal candidate will have expertise in developing scalable data processing pipelines using Pyspark.

• Design, develop, and deploy large-scale data processing pipelines using Pyspark.
• Collaborate with cross-functional teams to identify business requirements and design solutions.
• Develop and maintain high-quality code that meets performance, security, and reliability standards.
• Troubleshoot and resolve complex technical issues related to Pyspark development.
• Mentor junior developers to improve their skills and knowledge.
• Participate in code reviews to ensure adherence to coding standards.

• Strong understanding of big data technologies such as Hadoop, Spark, and NoSQL databases.
• Experience with Pyspark development, including data pipeline design, development, and deployment.
• Excellent problem-solving skills and the ability to analyze complex technical issues.
• Strong communication and collaboration skills to work effectively with cross-functional teams.
• Ability to design and implement scalable data processing architectures.
• Experience with agile development methodologies and version control systems.