Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using AWS/GCP cloud platforms.
• Collaborate with cross-functional teams to gather requirements and design ETL processes for complex datasets.
• Develop high-performance SQL queries and PySpark scripts to extract insights from massive datasets.
• Troubleshoot issues related to data processing workflows and provide timely resolutions.

Job Requirements :

• 3-5 years of experience in Data Engineering with expertise in AWS/GCP cloud technologies.
• Strong proficiency in Python programming language with experience working with popular libraries like Pandas, NumPy etc.
• Experience working with big-data technologies such as Hadoop ecosystem (HDFS), Spark (PySpark) etc.