Pyspark Developer (Open For Pune /Kolkata also)

Competencies Required

Essentials

• PySpark and Spark SQL
• Working with Dataframes using different APIs
• Spark Functions
• Advanced Data transformations
• Good knowledge in SQL
• Applying UDFS
• Error handling, logging and monitoring
• Unix, Scheduling Tool
• Performance Tuning & Generic process development
• Banking Domain Knowledge

Desirable

• ETL Estimation
• Teradata BTEQ

Responsibility of / Expectations from the Role

1. ETL Technical Designing, Guiding Team for solving Technical Problems, Providing Technical Solution to Client

2. Understanding Business Requirement and converting to Technical specification, Execution Planning

3. Effort Estimation, Task assignment to the team and tracking of activities, Performance Tuning

4. Hands on development for complex modules, ensuring coding standards, quality of delivery