ETL Testing with Azure

Role & responsibilities

Required Skills

• 68+ years of experience in ETL/Data Warehouse Testing.
• Strong SQL skills, including complex joins, subqueries, CTEs, window functions, and data reconciliation.
• Hands-on experience with Azure Data Factory.
• Good knowledge of Azure Data Lake Storage, Azure SQL, and Azure Synapse Analytics.
• Experience with Azure DevOps or similar defect/test management tools.
• Understanding of SDLC/STLC and Agile methodologies.

Good to Have

• Experience with PySpark / Databricks testing.
• Knowledge of Python for test automation and data validation.
• Experience with CI/CD pipelines and Azure DevOps.
• Knowledge of Power BI data validation.
• Experience with cloud data warehouses and modern data platforms.
• Familiarity with automated ETL testing frameworks

Preferred candidate profile

Key Responsibilities

• Design and execute ETL/ELT test scenarios for data ingestion, transformation, migration, and validation.
• Validate data pipelines built using Azure Data Factory (ADF) and ensure data is accurately transferred between source and target systems.
• Perform source-to-target data validation, including data completeness, accuracy, consistency, and integrity checks.
• Validate data transformations, business rules, aggregations, joins, lookups, and calculated fields.
• Write and execute complex SQL queries for backend/database validation.
• Test data stored in Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake Storage (ADLS).
• Validate ADF pipelines, datasets, linked services, triggers, parameters, variables, and error-handling mechanisms.
• Participate in Agile ceremonies including sprint planning, daily stand-ups, reviews, and retrospectives.
• Prepare test cases, test data, test execution reports, defect reports, and test summary reports.