Spark Scala Developer

Scala Spark Developer

Job Description

We are looking for an experienced Scala Spark Developer with strong hands-on expertise in Scala, Functional Programming, and Apache Spark. The candidate will be responsible for developing scalable data solutions, performing data analysis, optimizing applications, and working closely with business and technology stakeholders in an Agile environment.

Key Responsibilities

• Understand business requirements and implement tactical or strategic technology solutions.
• Collaborate with stakeholders to understand business needs and technical requirements.
• Design and develop scalable applications using Scala and Apache Spark.
• Apply strong Functional Programming concepts in Scala while developing robust and maintainable code.
• Perform data analysis, data profiling, and data lineage activities.
• Write and optimize complex SQL queries on RDBMS / DB2 databases.
• Optimize code and Spark applications for performance, scalability, and configurability.
• Develop and support solutions on HDFS platforms.
• Prepare technical design and solution documentation following Agile/Scrum standards.
• Perform unit testing using automated BDD frameworks and support regression testing and UAT.
• Follow automated release and deployment processes across environments.
• Work collaboratively with cross-functional technology teams.

Required Skills

• 5+ years of hands-on experience in Scala and Apache Spark development.
• Strong understanding of Scala as a programming language and Functional Programming concepts.
• Hands-on experience developing Spark applications using Scala.
• Strong SQL skills with DB2 / RDBMS.
• Minimum 2 years of hands-on experience with HDFS platform development.
• Strong knowledge of data analysis, data profiling, and data lineage.
• Experience in code optimization for performance, scalability, and configurability.
• Good understanding of Agile/Scrum methodology.
• Strong verbal and written communication skills.

Preferred Skills

• BDD and automated testing frameworks.
• Automated regression testing.
• CI/CD and automated release processes.
• Experience supporting UAT.
• Experience working with cross-functional technology teams.

Experience

5+ Years

Key Skills

Scala | Apache Spark | Functional Programming | HDFS | SQL/DB2