Data Quality Analyst

Greetings from NESS DIGITAL Engineering !!!

Job Description for Senior Data Quality Analyst” role

Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources. Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake, Azure synapse Must have hands-on experience in PySpark, SparkSQL, T-SQL Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines. Should be able to write reusable PySpark and T-SQL script to validate data across layers. Experience of working in Databricks Delta Lake will be highly desirable. Ideally should have worked in a team using Agile methodology.

• 3- 6+ hands-on years of testing exp
• Working experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage and Data Quality for various data feeds coming from the source
• Experience in database testing, data comparison & data transformation scripting
• Good knowledge Data Warehousing concepts & Data Modelling
• Must have good hands-on experience in creating Stored Procedures, Functions, Tables, Cursors, Hashtables and handling large data types.
• Should know about working of Joins, Subqueries, CTEs and complex query writing skills
• Experience in testing of reports, BO Universe
• Experienced in structured test methods and processes
• Azure Infra & Networking know-how and Testing
• Cloud Azure PaaS Analytics & Storage services know-how and Testing
• Good understanding of Azure Security like identity and access controls, safeguarding data, keys & secret management, securing network, general information protection, understanding of threats like DDoS etc
• Experience in SAP HANA projects would be added advantage