Big Data Developer

Job Description

1 Role** Senior Big Data Developer

2 Required Technical Skill Set** Development with Spark, Scala , HDFS, Hive, HQL, good understanding of the Hadoop File Formats, Good Expertise on REST API , SQL , GIT , Shell/Python Scripting.

4 Desired Experience Range** 5 to 13

5 Location of Requirement Bangalore Chennai hyd

Desired Competencies (Technical/Behavioral Competency)

Must-Have** • Spark Scala - Proficiency in coding and transforming raw requirements into technical solutions. • Hadoop - Experience with HDFS infrastructure and platform. Proficiency in the HDFS commands • SQL - Python Scripting • GitHub -Expertise in code management throughout the entire development lifecycle

Good-to-Have • Hive, • SonarQube • Shell Scripting • NoSQL technologies.

SN Responsibility of / Expectations from the Role

Technical Skills • 3 to 8 years of experience on application development with Spark/Scala • Good hands-on experience of working on the Hadoop Eco-system ( HDFS, Hive, Spark ) • Good understanding of the Hadoop File Formats • Good Expertise on REST API , SQL , GIT , Shell/Python Scripting. • Expertise in the implementation of the Data Quality Controls • Ability to interpret the Spark UI and identify the bottlenecks in the Spark process and provide the optimal solution. Tools • Ability to learn and work with various tools such as IntelliJ, GIT, Control M, Sonar Qube and also on board the new frameworks into the project. • Should be able to independently handle the projects. Agile • Good to have exposure to CI/CD processes • Exposure to Agile methodology and processes Others • Ability to understand complex business rules and translate into technical specifications/design. • Write highly efficient and optimized code which is easily scalable. • Adherence to coding, quality and security standards. • Effective verbal and written communication to work closely with all the stakeholders • Should be able to convince the stakeholders on the proposed solutions.