Data Test Lead

Key Responsibilities

•         Define and lead the end-to-end data testing strategy for large-scale EDW migration programmes from legacy ETL platforms to cloud-native architectures.

•         Drive source-to-target reconciliation, parallel testing, and transformation validation to ensure Azure Data Factory and dbt outputs align with existing Ab Initio processing logic and business rules.

•         Design, develop, and automate robust data validation frameworks using:

o    dbt testing capabilities

o    SQL-based reconciliation techniques

o    ADF validation activities

o    Custom validation and audit frameworks

•         Validate complex transformation logic, aggregations, business rules, and dimensional models across staging, curated, and reporting layers.

•         Lead and mentor distributed QA and testing teams across onsite and offshore delivery models.

•         Coordinate SIT, UAT, regression, reconciliation, and production validation activities.

•         Track test execution progress, defect management, data quality KPIs, and testing metrics for stakeholder and programme reporting.  

•         Build reusable frameworks for:

o    Continuous data quality monitoring

o    Automated reconciliation

o    Data lineage validation  

o    Source-to-target validation

o    Regression testing

•         Collaborate closely with Data Architects, ETL Developers, Business Analysts, and Platform Teams to ensure successful migration delivery.

•         Support root cause analysis and defect triage activities for data discrepancies and pipeline failures.

•         Ensure adherence to enterprise governance, audit, compliance, and data quality standards.

Required Skills & Experience

•         10+ years of experience in Data Warehouse and ETL Testing, including leadership responsibilities.

•         Strong understanding of ETL/ELT concepts and legacy-to-cloud migration testing methodologies.

•         Extensive experience in:

o    Data validation

o    Transformation testing

o    Reconciliation testing

o    Source-to-target testing

o    Data quality assurance

•         Strong knowledge of Ab Initio components and validation of graphs, mappings, and processing workflows.

•         Experience testing Azure Data Factory pipelines, orchestration flows, and metadata-driven frameworks.

•         Hands-on expertise in dbt including:

o    dbt tests

o    snapshots

o    SQL-based transformation validation

o    model validation

o    lineage verification

•         Advanced SQL expertise with modern cloud databases such as Snowflake.

•         Strong understanding of dimensional modelling and enterprise data warehousing concepts.

•         Experience with defect management and test management tools such as JIRA, Azure DevOps, or equivalent.

•         Strong stakeholder management, communication, and leadership capabilities.