HYDERABAD · FULLTIME
AI Engineering Manager
EPAM Systems
Hyderabad · hybrid · Posted 66d ago
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.4s
- Found the form on Naukri · 7 questions to answer1.5s
- Decided the answers for all of them2.6s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Position Overview
We are seeking a highly experienced, visionary, and Hands-on AI Engineering Manager to lead our AI engineering squad. In this role, you will bridge the gap between cutting-edge AI research and production-grade software engineering. With 1217 years of experience in the technology industry, you are someone who has evolved alongside the software landscapepossessing deep roots in backend engineering and distributed systems, coupled with advanced expertise in deploying Generative AI, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG) systems.As a hands-on manager, you will split your time between strategic technical leadership (coding, system architecture, prototyping) and people management (mentoring engineers, aligning with product strategy, and managing deliverables). You will be instrumental in defining our AI roadmap, building robust AI/LLM infrastructure, and delivering secure, scalable, and highly performant AI-driven applications.
Key Responsibilities
Technical Leadership & Architecture (approx. 50%)
- Architect AI Solutions: Design and implement robust, scalable, and secure architectures for AI-powered applications, prioritizing cost-efficiency, low latency, and reliability.
- Hands-on Coding: Write clean, production-grade, and highly optimized code (primarily in Python, Go, or Java). Lead by example in code quality, unit testing, and continuous integration.
- LLM Orchestration & RAG: Architect sophisticated Retrieval-Augmented Generation (RAG) pipelines, multi-agent frameworks (e.g., LangGraph, CrewAI, AutoGen), and advanced prompt-engineering workflows.
- Evaluation & Observability: Implement comprehensive evaluation frameworks (e.g., Ragas, TruLens) and LLM observability/monitoring systems (e.g., LangSmith, Phoenix, Arize) to ensure AI response quality and mitigate hallucinations.
Required Skills & Qualifications
- Total Experience: 12–17 years of professional software engineering and system design experience, with a proven track record of shipping production-grade SaaS, enterprise, or consumer applications.
- AI/ML Focus: 2-3 years of dedicated experience building and deploying machine learning or AI models, with at least 2 years of hands-on experience working directly with Generative AI, LLMs, and RAG architectures.
- Leadership Experience: 3+ years of experience formally managing engineering teams, executing performance reviews, and steering technical roadmaps.
- Core Technical Stack:
- Expertise in Java/.Net/Python.
- Experience with LLM Frameworks: LangChain, LlamaIndex, or Haystack.
- Familiarity with deep learning frameworks (PyTorch, TensorFlow) and Hugging Face Transformers.
- Proficiency in modern database technologies, specifically Vector Databases (Pinecone, Qdrant, Milvus, Weaviate).
- Education: Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, or a highly quantitative field (or equivalent practical experience).
Please share your profiles to [email removed]
Sourced from naukri
Section · 02
Skills
Section · Company
About EPAM Systems

EPAM Systems
IT Services & Consulting
10.1k+
employees
1993
33 years old
Newtown, Pennsylvania, United States
US
About
Industries
Employee ratings
2,036 reviews
Culture
3.7
Career growth
3.1
Work-life
3.8
Employees rate it well for
Find them on