Principal Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Airflow to extract insights from Snowflake databases.
• Collaborate with cross-functional teams to identify business requirements and design scalable solutions for complex data processing workflows.
• Develop high-quality Python code using Cortex framework to integrate with Snowflake SQL queries for efficient data retrieval and manipulation.
• Troubleshoot issues related to pipeline failures, performance optimization, and data quality assurance.

Job Requirements :

• 7-22 years of experience in Data Engineering with expertise in Airflow, Cortex, Python programming language.
• Strong understanding of Snowflake database management system including its architecture, features, and best practices.
• Experience working on big-data processing projects involving large-scale datasets stored in Snowflake tables.