Snowflake Data Engineer

Job Description Data Engineer

Experience:10+yrs

Location:Hyderabad

Role: Data Engineer

Job Summary

We are looking for a skilled Data Engineer with strong expertise in SQL, Python, ETL, data modelling, and Snowflake. The candidate will be responsible for designing and implementing scalable data pipelines and architectures, developing complex data transformations, and supporting data science and cross-functional teams.

Key Responsibilities

• Design and implement scalable data pipelines and data architectures using Snowflake and related technologies.
• Develop and optimize complex SQL queries and Python scripts for data transformation, aggregation, analysis, and ad hoc requirements.
• Design and implement ETL processes, translating source-system designs into fact and dimension tables.
• Handle source change data capture (CDC) requirements and ensure efficient data ingestion.
• Develop data models supporting data science projects, particularly large historical snapshot tables and datasets with multiple features.
• Optimize data flow and pipeline performance for cross-functional teams.
• Implement scalable and distributed data architectures based on business and technical requirements.
• Ensure data security, governance, and compliance in line with industry standards and regulatory requirements.
• Evaluate emerging technologies and recommend appropriate solutions for data engineering requirements.
• Manage and optimize Snowflake data warehouse environments.

Required Skills

• Strong hands-on experience with SQL and/or Python for data analysis and query development.
• Good understanding of ETL processes and data engineering concepts.
• Strong knowledge of data modelling principles, including fact and dimension modelling.
• Experience working with large historical datasets/snapshot tables and multiple data features.
• Strong experience with Snowflake data warehousing.
• Experience with Snowflake architecture, management, and Snowpipe.
• Understanding of data security, governance, and compliance.
• Ability to design scalable and distributed data architectures.
• Strong analytical and problem-solving skills.
• Ability to work effectively with cross-functional teams.

Preferred Skills

• Experience with Snowflake Snowpipe and data ingestion frameworks.
• Experience with Change Data Capture (CDC).
• Experience supporting data science and analytics projects.
• Exposure to cloud-based data platforms and modern data engineering technologies.
• Strong ability to learn and evaluate emerging technologies.