ETL Test & Automation Engineer

About Persistent We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what?s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India, and numerous innovators across the healthcare ecosystem. Our disruptor?s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation, leadership, and inclusion. We reported $1,654.4M FY26 revenue with 17.4% Y-o-Y growth. We have delivered 24 sequential quarters of growth with $436.0M in Q4 FY26 revenue, up 3.2% Q-o-Q and 16.2% Y-o-Y growth. Our 27,500+ global team members, located in 18 countries, have been instrumental in helping the market leaders transform their industries. We have been recognized as the Fastest Growing IT Services Brand Globally in the 2026 Brand Finance IT Services 25 Report. We named a Leader in the Everest Group Private Equity (PE) Services PEAK Matrix? Assessment 2026 and Software Product Engineering PEAK Matrix? Assessment 2026.

About Position We are looking for a skilled ETL Test & Automation Engineer to design, develop, and maintain automated test frameworks for data pipelines, ETL workflows, XML/JSON payloads, and MDM systems. The ideal candidate has deep hands-on experience in Python-based test automation, data quality validation, and cloud-native data platforms such as Azure Databricks, AWS Redshift, and Informatica.

• Role: ETL Test & Automation Engineer
• Location: All Persistent Locations
• Experience: 6 to 12 Years
• Job Type: Full Time Employment

What You'll Do ETL Pipeline Testing

• Design and execute test strategies for ETL pipelines built on DBT ,Informatica , Databricks
• Validate data transformation logic across Bronze, Silver, and Gold layers of Medallion Architecture
• Perform source-to-target (STT) mapping validation for migrations (Informatica to Databricks, Redshift to Delta Lake)
• Validate incremental and full-load ETL pipelines including CDC (Change Data Capture) scenarios
• Test DLT (Delta Live Tables) pipelines including DLT Expectations and data quality rules

Test Automation Framework

• Build and maintain Python-based test automation frameworks using pytest, PySpark
• Develop reusable test utilities for schema validation, null checks, duplicate detection, and row count reconciliation
• Integrate automated test suites into CI/CD pipelines (Azure DevOps / GitHub Actions)
• Automate regression testing for pipeline deployments across DEV, QA, and PROD environments
• Implement data diff and checksum-based validation for large-scale table migrations

XML & API Validation

• Validate XML payloads against XSD schemas using lxml and xmlschema libraries
• Test REST API integrations (Jira, ServiceNow, ADO, SFTP) for data ingestion pipelines
• Perform business rule validation on XML-based customer, order, and product feeds
• Validate JSON schema contracts and API response structures for event-driven pipelines

MDM & Domain Validation

• Validate MDM golden records for Customer, Product, and Vendor domains
• Test deduplication logic, survivorship rules, and cross-system data consistency
• Validate row-level and column-level security rules in Unity Catalog (masking functions, row filters)
• Test SCD Type 1 and Type 2 implementations in Delta Lake

Data Quality & Reporting

• Define and enforce DQ rules using Great Expectations, dbt tests, or custom pytest assertions
• Build automated data quality dashboards and test result reports
• Track test metrics: pass rate, coverage, defect density across pipeline stages
• Raise and manage defects using Jira / Azure DevOps with detailed root cause analysis

Expertise You Will Bring

• Bachelor's Computer Science, Information Technology, or related field
• 6 to 12 years of experience in ETL testing, data quality, or test automation roles
• Hands-on experience with Informatica PowerCenter / IICS and cloud data platforms (Azure / AWS)
• Strong understanding of data warehousing concepts: Star Schema, SCD, CDC, Medallion Architecture
• Experience testing large-scale data migration projects (source system to cloud data lake)
• Excellent analytical and debugging skills for identifying root cause of data discrepancies
• ISTQB / CSTE certification preferred but not mandatory

Benefits

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let?s unleash your full potential at Persistent - persistent.com/careers

• Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.? Testing,Test Planning,Databricks