Advisory Software Engineer

The Job

• Analyze, develop and support ETL and CDC pipelines in and out of data warehouse with a focus on automation, performance, reliability, durability, data quality, security and SLA expectations
• Provide production support for Data Warehouse issues such data load problems, transformation translation problems
• Perform data mappings and design of system for ETL/CDC workflow solutions
• Adhere to and promote CI/CD best practices, processes, and deliverables in accordance with modern standards in a DataOps environment
• Work closely with business analysts to implement integration technology solutions that meet the specifications of a project or service request
• Develop automated data audit and validation processes
• Participate in architectural design review sessions and ensure all solutions are aligned to pre-defined specifications
• Ensure accurate and timely data availability to meet business SLA, especially around critical time periods
• Document ETL and data warehouse processes and flows

Qualifications Skills required

• Ability to support and/or develop ETL pipelines and scripts in and out of data warehouse using combination of HVR, Goldengate, Snaplogic, Python and Snowflake s SnowSQL
• Experience with different source systems like SAP, HANA, OLFM and SalesForce preferred
• Strong SQL skills including stored procedures
• Extensive experience performance tuning, troubleshooting and debugging solutions
• Experience in supporting Data Warehouse and data transformation issues
• Demonstrated experience providing production support during time sensitive situations
• Experience in integrating premise infrastructure with public cloud (AWS, AZURE, Snowflake)
• Experience with AIX/Linux shell scripting
• Experience performing detailed data analysis (i.e. determining the structure, content, and quality of the data through examination of source systems and data samples)
• Ability to translate requirements for BI and Reporting and data transformations
• Ability to design and outline solutions using cloud based and on-premises technologies
• Ability to understand data pipelines and modern ways of automating data pipeline
• Actively test and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions
• Expert in source and target system analysis and prior experience on project analysis and cost estimations
• Ability to work effectively in a remote team environment
• Excellent written and verbal communication, time management, and presentation skills

Additional Skills

• Problem-Solving: Ability to troubleshoot and resolve technical issues efficiently.
• Communication: Effective communication skills to interact with stakeholders and team members.
• Analytical Thinking: Ability to analyse data and identify patterns and trends.
• Attention to Detail: Meticulous approach to ensure data accuracy and integrity.
• Adaptability: Willingness to learn new technologies and adapt to changing requirements.
• Time Management: Effective time management skills to meet project deadlines.
• Adaptability: Flexibility to adapt to changing project requirements.
• Stakeholder Management: Ability to manage expectations and build relationships with stakeholders.

Experience

• More than 1 years experience with Snowflake cloud-based data warehouse
• Hands-on experience with at least one Snowflake project
• 4-6 years experience developing ETL, ELT and Data Warehousing solutions
• 4-6 years experience with HVR or Snaplogic (preferred)
• More than 2 years experience with CDC technologies(preferred)
• More than 2 years experience AWS cloud, Azure or Google cloud
• 2-4 years experience developing Python based code that reads/writes data into databases
• 2-4 years experience developing SQL scripts and stored procedures that process data from databases
• 2-4 years experience with batch job scheduling and identifying data/job dependencies
• Strong understanding of various data formats such as CSV, XML, JSON etc.