AI Test Engineer -Testing Services
BirlaSoft · Bengaluru · onsite · Posted 42d ago
Undisclosed4–5 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Area(s) of responsibility
. Job Title: Senior AI Test Engineer
Experience: 4-5 Years
Location: Hybrid / Onsite
Employment Type: Full-time
Experience: 4-5 Years
Location: Hybrid / Onsite
Employment Type: Full-time
Key Responsibilities
- Define and implement end-to-end test strategies for AI-enabled applications.
- Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
- Perform functional, integration, regression, system, and UAT testing.
- Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
- Develop and maintain API automation frameworks.
- Validate AI model responses for:
- Accuracy
- Relevance
- Consistency
- Hallucinations
- Bias
- Toxicity
- Test prompt engineering scenarios and optimize prompt quality.
- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
- Verify AI guardrails, content moderation, and responsible AI compliance.
- Perform database validation using SQL.
- Conduct performance and load testing for APIs and AI services.
- Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
AutomationRetrieval Augmented GenerationPostman Toolrestful apisapisai servicescontent moderationregressionai modelLoad testingVectorLarge Language Models (LLMs)SQLSwaggerREST APIcomplianceRest AssuredGenerative AiArtificial IntelligenceMachine LearningApi Automation
About Birlasoft

BirlaSoft
IT Services & Consulting
10.9k+
employees
1995
31 years old
Pune, Maharashtra
India
About
Birlasoft combines the power of a domain, enterprise, and digital technologies to reimagine business potential. Surpassing expectations, breaking convention!
Industries
IT Services & Consulting
Employee ratings
3,764 reviews
3.4/ 5
Culture
3.3
Career growth
2.6
Work-life
3.6
Employees rate it well for
Work Life Balance532Salary397Senior Management376Work Culture319Appraisal309
Find them on