Senior Software Engineer-Data Engineer

Roles and Responsibilities :

• Design, develop, test, and deploy data pipelines using Data Bricks on GCP to extract insights from large datasets.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop scalable and efficient algorithms in Python using PySpark to process massive datasets.
• Troubleshoot issues related to data processing, pipeline failures, and provide recommendations for improvement.

Job Requirements :

• 5-7 years of experience in software engineering with expertise in big data technologies such as Hadoop, Spark, etc.
• Strong proficiency in programming languages like Python and familiarity with cloud platforms like GCP.
• Experience working with Data Bricks for building end-to-end data pipelines is essential.