Analyst

Job Summary

Who you are. Develop and maintain complex data pipelines and ETL processes in Snowflake. Write efficient and optimized SQL queries for data extraction, transformation, and loading. Utilize Python for advanced data processing, automation tasks, and integration with other systems. Implement and oversee data modelling techniques, including OLTP, OLAP, and Data Vault 2.0 methodologies. Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions. Manage and optimize CI/CD pipelines using Azure DevOps for seamless deployment of data solutions. Ensure data quality, integrity, and compliance throughout the data lifecycle. Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements. Document data models, processes, and workflows clearly for future reference and knowledge sharing.

Responsibilities

• Develop and maintain complex data pipelines and ETL processes in Snowflake.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading.
• Utilize Python for advanced data processing, automation tasks, and integration with other systems.
• Implement and oversee data modelling techniques, including OLTP, OLAP, and Data Vault 2.0 methodologies.
• Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions.
• Manage and optimize CI/CD pipelines using Azure DevOps for seamless deployment of data solutions.
• Ensure data quality, integrity, and compliance throughout the data lifecycle.
• Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements.
• Document data models, processes, and workflows clearly for future reference and knowledge sharing.
• Performance Tuning: Implement advanced techniques for performance tuning methodologies in Snowflake to optimize query performance and reduce data processing time.
• DBT Development: Develop and maintain DBT models, macros, and tests for managing data transformations in Snowflake.
• Version Control Management: Manage version control using Git repositories, enabling seamless code management and collaboration.
• CI/CD Pipeline Development Automation: Design, implement, and maintain automated CI/CD pipelines using Azure DevOps for Snowflake and DBT deployment processes.
• Impacts the effectiveness of own work team through the quality and timeliness of the work produced.
• Largely works within standardized procedures and practices to achieve objectives and meet deadlines and gains some discretion in problem solving.

Requirements

• Minimum of 5 years of proven experience as a Snowflake Developer or in a similar data engineering role.
• Extensive hands-on experience with SQL and Python, demonstrating proficiency in data manipulation and analysis.
• Significant industry experience working with DBT (Data Build Tool) for data transformation.
• Strong familiarity with CI/CD pipelines, preferably in Azure DevOps.
• Deep understanding of data modelling techniques (OLTP, OLAP) and best practices.
• Experience in working with large datasets and performance tuning in Snowflake.
• Familiarity with data governance, data security best practices, and compliance standards.
• Knowledge of additional data technologies (e.g., AWS, Azure) is a plus.
• Experience in leading projects or mentoring junior developers is advantageous.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.