Pyspark Developer

Job Requirements

Developing and supporting scalable, extensible, and highly available data solutions

Deliver on critical business priorities while ensuring alignment with the wider architectural vision

Identify and help address potential risks in the data supply chain

Follow and contribute to technical standards

Design and develop analytical data models Experience of relational databases and using SQL for data querying, transformation and manipulation

Experience of modelling data for analytical consumers

Ability to automate and streamline the build, test and deployment of data pipelines

• Experience in cloud native technologies and patterns
• A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
• Excellent communication and problem-solving skills
• An inclination to mentor; an ability to lead and deliver medium sized components independently
• AI-Driven Development: Leverage AI tools, such as GitHub Copilot, to enhance development efficiency, accelerate delivery timelines, and optimize software solutions.
• AI Landscape Awareness: Maintain awareness of the rapidly evolving AI landscape and proactively propose innovative approaches to implement product features.
• Problem Solving and Troubleshooting: Possess the expertise to analyze and effectively troubleshoot complex coding, application performance, and design challenges.
  
  

Work Experience

5-7Years