AI Engineer, PDS BI&T

Working with Us Challenging. Meaningful. Life-changing. Those aren’t words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the lives of patients, and the careers of those who do it. You’ll get the chance to grow and thrive through opportunities uncommon in scale and scope, alongside high-achieving teams. Take your career farther than you thought possible. Bristol Myers Squibb recognizes the importance of balance and flexibility in our work environment. We offer a wide variety of competitive benefits, services and programs that provide our employees with the resources to pursue their goals, both at work and in their personal lives. Read more careers.bms.com/working-with-us.

Position Summary The Senior Manager role will architect and develop autonomous multi-agent systems that power analytics, diagnostics, and decision support across Product Development and Supply. This role focuses on building graph-based orchestration workflows that combine LLM reasoning with business logic, real-time data integration, and enterprise security patterns. You will design agent platforms that go beyond conversational interfaces to deliver autonomous analytical workflows, automated validations, and intelligent routing across diverse business domain

Position Responsibilities* Key Responsibilities

Multi-Agent System Architecture & Platform Development

• Design and implement autonomous agent workflows using orchestration frameworks (LangGraph, CrewAI, Autogen, or similar)
• Build complex state machines with conditional routing, parallel execution, and error recovery patterns for analytical and diagnostic tasks
• Develop graph-based workflows with 10+ nodes involving agent collaboration, task decomposition, and sequential/parallel execution
• Create reusable agent node libraries and extensible platform patterns supporting multiple business domains
• Design versioning strategies and testing frameworks for agent workflows (unit, integration, end-to-end)

Backend Development & API Design

• Build production FastAPI applications with async I/O patterns for PostgreSQL, Redis, and external services
• Implement Server-Sent Events (SSE) and WebSocket protocols for real-time agent streaming responses
• Design RESTful APIs and event-driven architectures for agent orchestration
• Develop robust error handling, graceful degradation, and enterprise security integration (LDAP, SSO, access control)
• Handle concurrent async operations and deploy containerized services using Docker and CI/CD pipelines

LLM Integration, Orchestration & Tool Calling

• Integrate cloud-based LLM providers (AWS Bedrock, Azure OpenAI, Anthropic Claude, OpenAI GPT-4)
• Design prompt management systems with versioning, templating, and dynamic compilation
• Implement conversation state persistence using Redis checkpointing for multi-turn agent interactions
• Build tool-calling protocols (Model Context Protocol, function calling) for external data sources and APIs
• Develop response transformation pipelines converting raw data into structured analytical outputs (charts, insights)
• Create hybrid intelligence patterns combining LLM reasoning with rule-based logic and statistical analysis

LLMOps, Observability & Optimization

• Integrate observability platforms (Langfuse, LangSmith, or similar) for end-to-end agent tracing and telemetry
• Build monitoring systems tracking agent performance, LLM usage, latency, costs, and quality metrics
• Implement evaluation frameworks measuring agent success rates, reasoning quality, and output accuracy
• Optimize token usage and manage LLM costs across production workflows

Cross-Functional Collaboration

• Partner with data engineers and business analysts to translate requirements into agent workflows
• Collaborate with UX teams on streaming interfaces and visualization requirements
• Mentor junior engineers on async Python patterns, agent design, and LLMOps best practices
• Participate in architecture reviews and contribute to documentation and knowledge sharing Desired Experience* | Required
• Bachelor's or Master's degree in Computer Science, Engineering, AI, Data Science, or related field
• 8+ years of software engineering experience with 2+ years building production LLM-powered applications
• Expert-level async Python programming (asyncio, async/await patterns)
• Experience with agentic orchestration frameworks LangGraph (preferred), LangChain, CrewAI, Autogen, or similar
• Production FastAPI or similar async web frameworks
• Integration with cloud LLM providers AWS Bedrock, Azure OpenAI, Anthropic, or OpenAI
• Docker containerization and Git version control
• Cloud platform experience AWS, Azure, or Google Cloud

Critical Agentic AI Experience

• Built autonomous agent systems performing multi-step tasks beyond simple chatbots
• Designed complex workflows with conditional logic and state management
• Implemented tool-calling patterns for external system integration
• Prompt engineering at scale (templating, versioning, optimization)
• Understanding of agentic design patterns (ReAct, Plan-and-Execute, tool-use agents)
• Strong problem-solving, communication, and ability to work in globally distributed teams

Ideal Candidates Would Also Have

• Prior experience in global life sciences especially in the PDS functional area will be a plus
• Experience working internationally with a globally dispersed team including diverse stakeholders and management of offshore technical development team(s)
• Strong communication and presentation skills

Other Qualifications

• Bachelor’s degree in AI, Data Science, Computer Science, Information Systems, Computer Engineering or equivalent is preferred
• Experience in implementing Agentic AI solution or MCP is preferred If you come across a role that intrigues you but doesn’t perfectly line up with your resume, we encourage you to apply anyway. You could be one step away from work that will transform your life and career.

Uniquely Interesting Work, Life-changing Careers With a single vision as inspiring as “Transforming patients’ lives through science™ ”, every BMS employee plays an integral role in work that goes far beyond ordinary. Each of us is empowered to apply our individual talents and unique perspectives in a supportive culture, promoting global participation in clinical trials, while our shared values of passion, innovation, urgency, accountability, inclusion and integrity bring out the highest potential of each of our colleagues.

On-site Protocol BMS has an occupancy structure that determines where an employee is required to conduct their work. This structure includes site-essential, site-by-design, field-based and remote-by-design jobs. The occupancy type that you are assigned is determined by the nature and responsibilities of your role Site-essential roles require 100% of shifts onsite at your assigned facility. Site-by-design roles may be eligible for a hybrid work model with at least 50% onsite at your assigned facility. For these roles, onsite presence is considered an essential job function and is critical to collaboration, innovation, productivity, and a positive Company culture. For field-based and remote-by-design roles the ability to physically travel to visit customers, patients or business partners and to attend meetings on behalf of BMS as directed is an essential job function.

Supporting People With Disabilities BMS is dedicated to ensuring that people with disabilities can excel through a transparent recruitment process, reasonable workplace accommodations/adjustments and ongoing support in their roles. Applicants can request a reasonable workplace accommodation/adjustment prior to accepting a job offer. If you require reasonable accommodations/adjustments in completing this application, or in any part of the recruitment process, direct your inquiries to adastaffingsupport@bms.com. Visit careers.bms.com/eeo-accessibility to access our complete Equal Employment Opportunity statement.

Candidate Rights BMS will consider for employment qualified applicants with arrest and conviction records, pursuant to applicable laws in your area. If you live in or expect to work from Los Angeles County if hired for this position, please visit this page for important additional information https //careers.bms.com/california-residents/

Data Protection We will never request payments, financial information, or social security numbers during our application or recruitment process. Learn more about protecting yourself at https //careers.bms.com/fraud-protection. Any data processed in connection with role applications will be treated in accordance with applicable data privacy policies and regulations. If you believe that the job posting is missing information required by local law or incorrect in any way, please contact BMS at TAEnablement@bms.com. Please provide the Job Title and Requisition number so we can review. Communications related to your application should not be sent to this email and you will not receive a response. Inquiries related to the status of your application should be directed to Chat with Ripley. R1604083 AI Engineer, PDS BI&T