Big Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale big data solutions using Scala/Spark on AWS cloud platform.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality software products that meet business needs.
• Develop complex SQL queries to extract insights from massive datasets stored in Dynamo DB.
• Troubleshoot issues related to Hadoop ecosystem components such as HDFS, YARN, MapReduce etc.

Job Requirements :

• 4-5 years of experience in Big Data engineering with expertise in Scala/Spark programming languages.
• Strong understanding of AWS cloud platform including S3 buckets, Glue ETL jobs, Lambda functions etc.
• Proficiency in writing efficient SQL queries for querying large datasets stored in Dynamo DB.
• Experience working with Java-based technologies like Spark Streaming APIs.