INDORE · FULLTIME
Python QA with AI/ML Experience
Infobeans
Indore · onsite · Posted 47d ago
Sourced from
Undisclosed4–8 yrsfulltimeIndore
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.6s
- Found the form on Naukri · 8 questions to answer1.7s
- Decided the answers for all of them2.1s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
- Job Description:AI/ML QA Specialist with strong Databricks experience
Job summary:
We are seeking for skilled AI/ML QA Specialists with strong Databricks experience to ensure the quality, reliability, and regulatory readiness of AI/ML platforms. This role will focus on endtoend testing of CCAR and ESG projects, covering data pipelines, feature engineering, model training, validation, deployment, and monitoring. The ideal candidate blends data engineering QA, ML lifecycle validation, and platform testing in cloudnative environments. The plan is to automate the QA Testing and make it part of the regression suite that will be run for every future deployment.
Key Responsibilities
Model Development Platform QA - Validate data ingestion, feature engineering, and training pipelines built on Databricks (Spark, Delta, MLflow).
- Design and execute QA strategies for:
- Dataset quality, schema validation, and lineage
- Feature consistency and drift checks
- Reproducibility of model training and experiments
- Test MLflow experiments, model versioning, and artifacts for completeness and traceability.
- Ensure compliance with model risk management (MRM), audit, and documentation standards.
- Conduct regression testing to ensure existing functionality remains unaffected after updates or enhancements.
- Model Execution / Production Platform QA
- Test model deployment pipelines, including batch and realtime model execution.
- Validate:
- Model scoring accuracy and performance
- Input/output data contracts and SLAs
- Error handling, fallback logic, and retries
- Perform regression, performance, and volume testing for production workloads.
- Validate monitoring metrics (model health, drift, latency, failures).
- Conduct regression testing to ensure existing functionality remains unaffected after updates or enhancements.
- Automation & Tooling
- Build and maintain automated test frameworks for data and ML pipelines (Databricks notebooks, PySpark, Python).
- Implement datadriven QA checks (DQ rules, nulls, thresholds, statistical validation).
- Integrate QA into CI/CD pipelines for ML workflows.
- Build automated regression suite to be run prior to any deployments.
- Governance & Collaboration
- Partner with Data Scientists, ML Engineers, Platform Engineers, and Model Risk teams.
- Support UAT, audit reviews, and regulatory validation initiatives.
- Document QA results clearly for technical and nontechnical stakeholders.
- Required Skills & Qualifications
- 58+ years of QA or data validation experience, with strong focus on AI/ML or data platforms
- Handson experience with Databricks:
- Spark / PySpark
- Delta Lake
- MLflow
- Strong Python experience for testing and automation
- Solid understanding of the ML lifecycle (data features training validation deployment)
- Experience testing:
- Data pipelines and largescale datasets
- Batch and realtime model execution
- Knowledge of cloud platforms (Azure preferred)
- Familiarity with CI/CD, Git, and automated testing frameworks
- Preferred / NicetoHave
- Experience with model risk management (MRM) or regulated environments (banking, risk, compliance).
- Exposure to:
- Feature stores
- Model monitoring and drift detection
- Power BI or downstream analytical reporting validation
- Experience with performance testing at scale in distributed environments.
- Prior work on platform modernization or cloud migration initiatives.
- Education
- Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field.
Sourced from naukri
Section · 02
Skills
AimlpytestPython TestingLarge Language Models (LLMs)Pytest FrameworkPython AutomationAI testingPythonAutomation TestingSeleniumAgentic Ai
Section · Company
About InfoBeans
Infobeans
IT Services & Consulting
1.2k+
employees
2000
26 years old
Indore, Madhya Pradesh
India
About
InfoBeans specializes in AI-led design and software solutions for its enterprise clients to solve their most complex business problems.
Industries
IT Services & Consulting
Employee ratings
430 reviews
3.3/ 5
Culture
3.4
Career growth
2.8
Work-life
3.5
Employees rate it well for
Work Culture64Senior Management41Work Life Balance40Working Hours/shift27Work Environment24
Find them on