Lead Software Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data processing pipelines using Scala/Spark.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Ensure high availability, scalability, security, and performance of software applications deployed on AWS cloud platform.
• Mentor junior engineers in best practices for coding standards, testing methodologies, and debugging techniques.

Job Requirements :

• 7-15 years of experience in software development with expertise in Scala/Spark programming languages.
• Strong understanding of big data technologies such as Apache Spark, Hadoop ecosystem (HDFS), Kafka messaging queues.
• Experience working with relational databases like PostgreSQL or Couchbase NoSQL database management systems.
• Proficiency in containerization using Docker/Kubernetes for deploying applications.