Support Executive - Big Data & Hadoop Ecosystems (PySpark Developer)

Required Technical Skill Set

Big Data PySpark, HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, Autosys

Desired Experience Range: 5-12

Desired Competencies (Technical/Behavioral Competency)

Must-Have

(Ideally should not be more than 3-5)

1. Good understanding of Hadoop concepts including file system and Map Reduce.

2. Hands on experience on Spark framework, Unix scripting, Hive queries, wriring UDF in Hive. Theortical knowledge and POC alone will not suffice.

3. Good knowledge in Software Development Life Cycle and Project Development Lifecycle.

4. Associate should be able to work independently and should have strong debugging skill in both Hive and Spark. Associate should have experience developing large scale systems, experience debugging and performance tuning, excellent software design skills, communication skills and ability to work with client partners. Hands on in Apache Spark with Python or any other language (Preferred is Python -PySpark)

Good-to-Have

1. Experience in Banking and Finance Domain.

2. Experience in Agile Methodology

3. Knowledge in job scheduling tools like Autosys.

4. Knowledge in Kafka.