Walk-in || Big Data Engineer - Spark & Scala

Required Technical Skill Set**

Bigdata Scala/Java, Python, Spark, Hive, Unix Shell Scripting

Responsibility of / Expectations from the Role

1 Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns

2 Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework

3 Develop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/Java

4 Provide solutions to Big data problems dealing with huge volumes of data using Spark based data transformation solutions , Hive, MPP processes like IMPALA.

5 Create Junit tests and ensure code coverage is met as per the agreed standards

6 Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors.