Automation AI Test Engineer
Sensiple · Chennai · onsite · Posted 40d ago
Undisclosed3–8 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Title: Automation AI Test Engineer
Location: Chennai
Shift: Overlapping / Night shift
Experience: 3+
Location: Chennai
Shift: Overlapping / Night shift
Experience: 3+
Responsibilities
- Agentic Benchmark Design: Generate, import, create, extend, and manage benchmarks for non-deterministic LLM agents, validating behaviour and responses
- Functional Regression Testing: Grow benchmarks and create new ones as new functionality or issues are uncovered.
- Benchmarking Automation Support: Contribute to streamlining the benchmarking process in alignment with product development work. Qualifications Basic Qualifications (Non-Negotiable)
- 3+ years of experience in software/product quality assurance.
- Confident usage of Bash and Python.
- Experience with manual testing and test case execution.
- Basic familiarity with automated testing frameworks such as Playwright or Selenium.
- Experience with testing web protocols (WebSocket message payload)
- Basic knowledge of load and performance testing (e.g., JMeter).
- Strong analytical and problem-solving abilities.
- Systems thinking
- Familiarity with prompt evaluation, function-calling, and tool-use testing. Preferred Skills
- Exposure to test automation scripting using Python.
- Experience with CI/CD integration.
- Familiarity with Conversational AI platforms and NLP-based applications.
- Experience with test management and result tracking.
- Experience testing conversational-agent systems and evaluating non deterministic outputs.
"},{"
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
AutomationScriptingPlaywrightBashProduct qualityregressionautomated testingPerformance TestingNatural Language ProcessingLarge Language Models (LLMs)CI/CD IntegrationApache JMeterRegression TestingConversational AiPythonmanual testingSeleniumProduct DevelopmentArtificial Intelligence
About Sensiple
Sensiple
IT Services & Consulting
442
employees
1999
27 years old
Chennai, Tamil Nadu
India
₹7.9L PA avg
Avg at Sensiple
About
Sensiple is a global IT Consulting Leader providing FinTech and RegTech, Intelligent Process Automation, Customer Experience Solutions and Digital Transformation Services.
Industries
IT Services & Consulting
Employee ratings
10 reviews
3.0/ 5
Culture
2.3
Career growth
2.3
Work-life
2.5
Employees rate it well for
Work-Life Balance30Skill Development30
Find them on