Senior Specialist - Data Engineering

Role Description

Senior data engineerIDMC for Data Quality Team IDMC Data Quality Data Engineering consultant

1 Key Responsibilities

Develop IDMC CDI mappings and Taskflows against approved design documents including the DQ evaluation mapping and the DQ orchestration Taskflow nested parallelsequential Iterator pattern Depending on the validated approach implement rule evaluation either as parameterised source SQL with embedded rule expressions CDIonly or as CDQ assets rule specifications maplets and dictionarybased validations integrated into CDI mappings

Build and maintain SQL Server database objects control tables rule library error fact tables staging tables and write productionquality TSQL for SQL tasks within Taskflows audit logging dynamic SQL assembly watermark logic dimension scoring

Populate and validate the DQ rule library translating quality rules into executable rule definitions across quality dimensions Completeness Validity Consistency Accuracy Uniqueness Timeliness in whichever form the validated approach requires TSQL CASE expressions or CDQ rule specifications

Execute unit testing QA integration testing and support production deployment across all three frameworks

Work in a paired development model with the IPS Lead Developer actively absorbing platform knowledge patterns and IDMC best practices

Participate in sprintend walkthroughs and formal knowledge transfer sessions contribute to implementation documentation

Demonstrate independent capability by engagement end able to add a new source connection register a new DQ rule and debug a failed run using the audit log without IPS support

2 Required Skills And Experiences

Must have

7 years handson data engineering ETL development experience in enterprise environments

Equal and demonstrated proficiency in both IDMC CDI and IDMC CDQ this is a dualcapability role

CDI mappings Taskflows parameter sets runtime parameter overrides dynamic field propagation genericreusable mapping patterns delivered in production

CDQ rule specifications maplets cleanseparseverifier assets dictionarybased validations and binding CDQ assets to CDI mappings delivered in production

Familiarity with the April 2026 Unified Data Quality capability DQ assets created directly within Data Integration is a strong advantage

Advanced SQL TSQL complex queries dynamic SQL stored procedure patterns performanceaware query design on SQL Server

Data Quality domain understanding quality dimensions rulebased validation error capture and scoring concepts

Experience working against formal design documentation with design authority governance

Comfortable in a paired mentored development model receptive to knowledge transfer and able to work alongside a senior external lead

Nice to have

Power BI development experience dataset design DAX measures Row Level Security useful for liaising with the Power BI track and understanding how DQ Framework output dimension scores error detail will ultimately be consumed downstream

Databricks or Azure Synapse as target platforms ABFS ADLS familiarity

Azure fundamentals AD groups Key Vault service principals

Experience in metadatadriven controltabledriven framework builds

Power BI data model awareness helpful for the dashboard track not required

Automotive or manufacturing industry background

3 Profile attributes

Selfsufficient developer who can take a designed component and deliver it with limited supervision

Detailoriented this programme has formal review gates source control discipline and design signoff requirements

Strong communicator in English daily collaboration with IPS Technical Lead and Data Architect

Genuinely motivated to learn the engagement is deliberately structured to build lasting IDMC capability and the consultant is one of the primary recipients of that investment

Role Senior Data Engineer IDMC Data Quality

We are looking for a Senior Data Engineer with strong handson experience in Informatica IDMC CDI CDQ SQL and modern AzureDatabricks data platforms The role involves developing a metadatadriven Data Quality framework building CDI mappings and Taskflows implementing CDQ rules and integrating data pipelines with Azure and Databricks

Candidate needs to travel to client office C V Raman Nagar Bagmane for 2 to 3 days or all days wherever applicable