Senior Specialist - AI Engineering
LTM · Bengaluru · onsite · Posted 1d ago
Undisclosed8–12 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Responsibilities
- Roles &Responsibilities: RCA Agent Development Design develop and enhance the RCA agent using GenAIagentic AI patterns Build prompts reasoning workflows toolfunction integrations and supporting APIs Optimize agent accuracy reliability latency safety and cost
- AD RCA Integration Integrate the upstream AD workflow with the RCA agent through enterprise APIsservice layers
- Implement data and workflow integration between the agent and dependent enterprise systems
- Validate endtoend integration and errorhandling scenarios
- Evaluation Framework Build an automated evaluation frameworktest harness for the RCA solution
- Define acceptance criteria and metrics covering accuracy factuality grounding safety latency and cost
- Perform regression adversarial hallucination guardrail and failurepath testing
- Use evaluation findings as release gates and inputs for system improvement
- E2E Tuning Optimization Analyze failures across the complete RCA pipeline and tune prompts context orchestration and inference behavior
- Improve accuracy and production reliability based on evaluation results
- Identify error propagation across multistep agent workflows through tracing and observability
- AWS SageMaker Bedrock Develop and operationalize agent workloads using Amazon Bedrock where applicable
- Support model deployment optimization monitoring and lifecycle activities using SageMaker
- Optimize prompts embeddings and inference performance
- Establish monitoring for production performance and anomalies
- Short version for JD RR Key Responsibilities Develop and enhance the RCA agent integrate ADtoRCA workflows build the GenAI evaluation framework perform endtoend testing and tuning optimize promptsmodel inference and support deployment monitoring and operationalization using AWS SageMaker and Amazon Bedrock
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
TestingorchestrationUsageCostamazon web servicesMonitoringdeploymentworkflowRCA