Lead Data Engineer

Responsibilities:

• Be part of developing scalable, reliable, and highly available production-level data platforms and data pipelines to meet various business needs.
• Be able to design (high-level/low-level) software solutions for new requirements.
• Code independently and with other team members with proper software industry-standard best practices.
• Collaborate with data analysts/product managers to understand the data.
• Mentor junior developers, conduct code reviews, and handle deployments.
• Work closely with QA and deliver the product end-to-end.

Requirements:

• B. E/MTech in computer science.
• 6+ years of experience in software development.
• Experience in building scalable products, preferably with big data.
• Good coding skills in Python; experience in Spark.
• Experience in either data warehouses or relational databases is mandatory.
• Experience in Kafka and stream/batch processing applications like Storm and KStreams.

Preferred Qualifications:

• Experience in the AWS cloud.
• Ability to work collaboratively across multiple products and application teams.