Walk-in || AWS + Pyspark Walk in

Role- Data Engineer

Required Technical Skill Set - ETL, SQL & AWS

Desired Experience Range - 5+ years

Location of Requirement-Hyderabad

Desired Competencies (Technical/Behavioral Competency)

Must-Have- Strong Knowledge of Aws Glue/AWS REDSHIFt/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.

Good-to-Have- Python

SN Responsibility of / Expectations from the Role

1 Good knowledge of SQL and Data warehousing Concepts

2 Experienced in AWS cloud services such as AWS EC2, AWS S3, AWS Lambda, AWS Glue and AWS Redshift

3 Hand on knowledge of Using Python & Pyspark for Data transformations

4 Good knowledge in glue to write transformation logic/ call custom code written in SQL /Pysprak file with transformation logic

5 To handle complex data processing using air flow

6 Cloud watch, custom logging using python

7 To perform data quality analysis using glue/pyspark