LLM Integration & CI/CD Engineer

Role : LLM Integration & CICD Engineer

Level : Senior Associate

Tower : AI Operations & Platform Support (AI Managed Services)

Experience : 5-10 Years

Key Skills : Integration Engineering; APIs/Connectors; CI/CD Pipelines; DevOps; Secrets/IAM; Release Management; Cloud (AWS)

Educational Qualification : Bachelor’s degree in Computer Science/IT or relevant field (Master’s or relevant certifications preferred)

Work Location : Bangalore / Hyderabad

Job Description As an AC - Senior LLM Integration & CICD Engineer, you will build, operate, and improve integrations and CI/CD pipelines supporting in-scope AI platforms and AI-enabled use cases. You will troubleshoot integration and deployment issues, implement secure and repeatable deployment patterns, coordinate release readiness with change governance, and drive operational improvements to increase reliability and speed.

Key Responsibilities: 1.Integration & Connector Engineering:

• Design, build, and support API-based integrations and connectors across in-scope AI platforms and enterprise systems.
• Troubleshoot integration failures and implement resilient patterns (retries, idempotency, error handling) with appropriate operational telemetry.

2.CI/CD Pipeline Engineering & Operations:

• Build and maintain CI/CD pipelines for in-scope AI workloads and supporting services, ensuring repeatable build, test, and deploy processes.
• Operate deployment pipelines in alignment with client change governance, ensuring safe promotion through environments and strong rollback readiness.
• Improve pipeline reliability and performance by reducing build failures, standardizing templates, and automating validation checks.

3.Release Management & Operational Readiness:

• Coordinate release readiness activities (deployment plans, rollback steps, runbooks, monitoring readiness) to reduce production risk.
• Support change execution and post-release verification to confirm expected behavior, stability, and integration health.
• Partner with incident command leadership during major events to restore service quickly for integration and deployment-related incidents.

4.Secrets Management, IAM & Secure Delivery:

• Implement and support secure secrets handling and access controls (least privilege) for pipelines, integrations, and service accounts.
• Ensure deployment and integration patterns align to applicable security, privacy, and compliance requirements and approvals.

5.Troubleshooting, Diagnostics & Incident Support:

• Provide L2/L3 troubleshooting for pipeline and integration incidents; analyze logs, traces, and configuration to identify root causes.
• Drive corrective actions to prevent recurrence, including changes to pipeline steps, configuration, monitoring, and documentation.

6.Automation & Standardization:

• Automate routine deployment and operational tasks to reduce manual effort and improve consistency (templates, reusable workflows, automated checks).
• Promote standardized integration and deployment patterns to improve maintainability and reduce operational risk across supported workloads.

7.Documentation & Knowledge Management:

• Maintain integration documentation, pipeline runbooks, and troubleshooting guides; ensure knowledge assets stay current as platforms evolve.
• Document operational boundaries, escalation paths, and common failure modes to improve support efficiency and onboarding.

8.Stakeholder Collaboration & Governance Support:

• Collaborate with platform owners, security teams, and service leadership to prioritize improvements and resolve cross-team issues.
• Provide inputs to service reporting on pipeline health, integration incidents, recurring issues, and improvement progress.

9.Quality, Controls & Operational Discipline:

• Follow defined operational processes (incident, request, change) and maintain high-quality ticket hygiene and documentation discipline.
• Proactively identify risks and control gaps in delivery processes and propose mitigations to improve safety and reliability.

10.Continuous Improvement:

• Identify opportunities to improve developer experience and time-to-release while maintaining strong controls and operational reliability.
• Contribute to continuous improvement planning by proposing backlog items, estimating effort, and supporting delivery of operational enhancements.

Required Skills:

• Strong experience with CI/CD tools and DevOps practices, including building and operating deployment pipelines for enterprise services.
• Hands-on experience designing and supporting API integrations and connectors, including troubleshooting and operationalizing integration health.
• Working knowledge of IAM and secrets management patterns, and experience implementing secure delivery practices (least privilege, approvals, controls).
• Experience operating within ITIL-aligned processes (incident, change) and coordinating releases with governance and operational readiness.
• Preferred: experience with enterprise ITSM and operational tooling (e.g., client ITSM and monitoring tools; ServiceNow), CI/CD platforms (e.g., GitHub Actions, Azure DevOps, Jenkins), infrastructure automation (e.g., Terraform), and cloud services (AWS). Familiarity with GenAI services (AWS Bedrock, OpenAI/ChatGPT Enterprise) is desirable. AWS certifications are highly preferred.

Managed Services- AI Services At PwC, we relentlessly focus on working with our clients to bring the power of technology and humans together and create simple yet powerful solutions. We imagine a day when our clients can simply focus on their business, knowing that they have a trusted partner for their IT needs. Every day, we are motivated and passionate about making our clients better. Within our Managed Services platform, PwC delivers integrated services and solutions that are grounded in deep industry experience and powered by the talent that you would expect from the PwC brand. The PwC Managed Services platform delivers scalable solutions that add more excellent value to our client’s enterprise through technology and human-enabled experiences. Our team of highly skilled and trained global professionals, combined with the latest advancements in technology and process, allows us to provide effective and efficient outcomes. With PwC’s Managed Services, our clients can focus on accelerating their priorities, including optimizing operations and accelerating outcomes. PwC brings a consultative first approach to operations, leveraging our deep industry insights, world-class talent, and assets to enable transformational journeys that drive sustained client outcomes. Our clients need flexible access to world-class business and technology capabilities that keep pace with today’s dynamic business environment. Within our global Managed Services platform, we provide AI Managed Services where we focus more so on the evolution of our clients’ AI portfolio. Our focus is to empower our clients to navigate and capture the value of their application portfolio while cost-effectively operating and protecting their solutions. We do this so that our clients can focus on what matters most to your business: accelerating dynamic, efficient and cost-effective growth. As a member of our AI Managed Service team, we are looking for candidates who thrive working in a high-paced work environment capable of working on a mix of critical Application Evolution Service offerings and engagement, including help desk support, enhancement and optimization work, as well as strategic roadmap and advisory level work. It will also be critical to lend experience and effort in helping win and support customer engagements from not only a technical perspective, but also a relationship perspective.