Sr Architect
BirlaSoft · Bengaluru · onsite · Posted 58d ago
Undisclosed11–20 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Area(s) of responsibility
Key Responsibilities
- Develop Python-based automation frameworks (Pytest)
- Test LLM outputs (accuracy, hallucination, relevance)
- Validate multi-agent workflows and pipelines
- Build evaluation metrics (F1, precision, recall)
- Perform API and integration testing
- Ensure high test coverage and CI/CD integration
- Strong Python programming
- Automation frameworks (Pytest/unittest)
- Understanding of GenAI/LLMs
- API testing and debugging
- CI/CD and version control
Sourced from naukri
Skills
AutomationworkflowspytestProgrammingpython programmingLarge Language Models (LLMs)CI/CD IntegrationdebuggingPythonAPI TestingIntegration TestingGIT
About Birlasoft

BirlaSoft
IT Services & Consulting
10.9k+
employees
1995
31 years old
Pune, Maharashtra
India
About
Birlasoft combines the power of a domain, enterprise, and digital technologies to reimagine business potential. Surpassing expectations, breaking convention!
Industries
IT Services & Consulting
Employee ratings
3,764 reviews
3.4/ 5
Culture
3.3
Career growth
2.6
Work-life
3.6
Employees rate it well for
Work Life Balance532Salary397Senior Management376Work Culture319Appraisal309
Find them on