LLM Operations Engineer
Accenture · Bengaluru · onsite · Posted 56d ago
Not disclosed5–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Project Role : LLM Operations Engineer
Project Role Description : Utilize cloud-native services and tools for scalable and efficient deployment. Monitor LLM performance, address operational challenges, and ensure compliance and security standards in AI operations.
Must have skills : Machine Learning Operations
Good to have skills : NA
Minimum 5 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Summary:
As a LLM Operations Engineer, you will utilize cloud-native services and tools for scalable and efficient deployment. Your typical day will involve monitoring the performance of large language models, addressing operational challenges, and ensuring that all activities comply with security standards in AI operations. You will collaborate with various teams to enhance operational efficiency and contribute to the overall success of AI initiatives within the organization.
Roles & Responsibilities:
Summary: Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.
Roles & Responsibilities: Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to address complex business challenges, automate processes, and integrate intelligent insights into enterprise workflows for measurable impact.
Professional & Technical Skills: Strong grasp of Generative and Agentic AI, prompt engineering, and AI evaluation frameworks. Ability to align AI capabilities with business objectives while ensuring scalability, responsible use, and tangible value realization.
Project Role Description : Utilize cloud-native services and tools for scalable and efficient deployment. Monitor LLM performance, address operational challenges, and ensure compliance and security standards in AI operations.
Must have skills : Machine Learning Operations
Good to have skills : NA
Minimum 5 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Summary:
As a LLM Operations Engineer, you will utilize cloud-native services and tools for scalable and efficient deployment. Your typical day will involve monitoring the performance of large language models, addressing operational challenges, and ensuring that all activities comply with security standards in AI operations. You will collaborate with various teams to enhance operational efficiency and contribute to the overall success of AI initiatives within the organization.
Roles & Responsibilities:
- Expected to be an SME.
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Facilitate knowledge sharing sessions to enhance team capabilities.
- Develop and implement best practices for operational efficiency.
- Must To Have Skills: Proficiency in Machine Learning Operations.
- Good To Have Skills: Experience with cloud-native platforms such as AWS, Azure, or Google Cloud.
- Strong understanding of model deployment strategies and monitoring tools.
- Experience with containerization technologies like Docker and Kubernetes.
- Familiarity with compliance and security standards in AI operations.
- The candidate should have minimum 5 years of experience in Machine Learning Operations.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.
Summary: Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.
Roles & Responsibilities: Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to address complex business challenges, automate processes, and integrate intelligent insights into enterprise workflows for measurable impact.
Professional & Technical Skills: Strong grasp of Generative and Agentic AI, prompt engineering, and AI evaluation frameworks. Ability to align AI capabilities with business objectives while ensuring scalability, responsible use, and tangible value realization.
Sourced from foundit
Skills
DockerKubernetesmachine learning operationsamazon web servicesMonitoring ToolsModel deployment strategiescloudMicrosoft AzureCompliance and security standards in AI operations
About Accenture

Accenture
IT Services & Consulting
350k+
employees
1989
37 years old
Dublin
Ireland
About
Accenture plc is an Irish-American, professional services company based in Dublin, specializing in information technology services and consulting.
Industries
IT Services & ConsultingAnalytics & KPOSoftware ProductManagement Consulting
Employee ratings
73,428 reviews
3.7/ 5
Culture
3.7
Career growth
2.8
Work-life
3.6
Employees rate it well for
Work Life Balance8779Work Culture7586Salary7496Learning5602Senior Management4852
Find them on