Senior Pyspark Developer - Capital Markets (7+ years)

Project Description:

We need a Senior Python Tester to work for a leading investment bank in Trade Surveillance Project

Responsibilities:

• Develop software applications based on business requirements

• Maintain software applications and make enhancements according to project specifications

• Participate in requirement analysis, design, development, testing, and implementation activities

• Propose new techniques and technologies for software development.

• Perform unit testing and user acceptance testing to evaluate application functionality

• Ensure to complete the assigned development tasks within the deadlines

• Work in compliance with coding standards and best practices

• Provide assistance to Junior Developers when needed.

• Perform code reviews and recommend improvements.

• Review business requirements and recommend changes to develop reliable applications.

• Develop coding documentation and other technical specifications for assigned projects.

• Act as primary contact for development queries and concerns.

• Analyze and resolve development issues accurately.

Mandatory Skills Description:

• 8+ years of experience in data intensive Pyspark development.

• Experience as a core Python developer.

• Basic experience in Gen/Agentic AI

• Experience developing Classes, OOPS, exception handling, parallel processing .

• Strong knowledge of DB connectivity, data loading , transformation, calculation.

• Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations.

• Lambda Functions, Decorators.

• Vector operations on Pandas dataframes /series.

• Application of applymap, apply, map functions.

• Concurrency and error handling data pipeline batch of size [1-10 gb].

• Ability to understand business requirements and translate them into technical requirements.

• Ability to design architecture of data pipeline for concurrent data processing.

• Familiar with creating/designing RESTful services and APIs.

• Familiar with application unit tests.

• Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.

• Debugging application.