Senior Engineer - AI Platform
Netconnect · Bengaluru · onsite · Posted 67d ago
Not disclosed7–9 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Description
Role Overview :
We are looking for a Senior Engineer AI Platform to design, develop, and improve enterprise-scale AI infrastructure and platform capabilities. The role combines platform engineering, distributed systems, cloud infrastructure, and Generative AI/Agentic AI, with a focus on building highly scalable, secure, resilient, and high-performance AI platforms.
Key Responsibilities
Role Overview :
We are looking for a Senior Engineer AI Platform to design, develop, and improve enterprise-scale AI infrastructure and platform capabilities. The role combines platform engineering, distributed systems, cloud infrastructure, and Generative AI/Agentic AI, with a focus on building highly scalable, secure, resilient, and high-performance AI platforms.
Key Responsibilities
- Design and develop enterprise-scale AI platform and infrastructure solutions.
- Build highly available distributed systems using active-active and failover architectures.
- Develop high-throughput, low-latency production services and APIs.
- Design and manage cloud-native AI infrastructure across AWS and Kubernetes.
- Build infrastructure supporting LLM and Agentic AI workloads.
- Implement and optimise AI model serving and inference infrastructure.
- Integrate AI platforms with enterprise applications and services.
- Collaborate with architects, product managers, engineers, and business stakeholders.
- Participate in code reviews and promote engineering best practices.
- Implement secure coding, testing, monitoring, and reliability practices.
- Contribute to technology strategy, platform standards, and continuous improvement.
- 7+ years of software/platform engineering experience, including 5+ years working with enterprise-scale platform or infrastructure architecture.
- Strong experience with distributed systems, high availability, active-active architecture, and failover patterns.
- Expert-level proficiency in Python, particularly FastAPI and asynchronous programming; Go or Java experience is also valuable.
- Strong AWS experience, including :
- EKS
- Bedrock
- IAM
- Aurora
- CloudFormation
- GPU scheduling
- Multi-tenancy
- Strong knowledge of Kubernetes and containerised infrastructure.
- Experience with service mesh technologies, particularly Istio and Envoy.
- Hands-on experience with Generative AI and Agentic AI, including :
- LangGraph / LangChain
- Google ADK
- MCP
- A2A protocols
- Prompt engineering
- RAG
- vLLM
- Experience building high-performance AI/ML platform infrastructure.
- Experience implementing AI safety and guardrails, including :
- Prompt injection detection
- PII redaction
- Content filtering
- Knowledge of AI security frameworks such as :
- NIST AI RMF
- MITRE ATLAS
- OWASP LLM Top 10
- Strong experience with Envoy Proxy, including xDS API, WASM filters, and AI Gateway extensions.
- Experience with GPU infrastructure and AI inference optimisation.
- Financial services or banking experience, particularly around regulatory requirements, data residency, and compliance.
- Strong analytical and problem-solving capabilities.
- Ability to influence technical direction and architectural decisions.
- Strong communication and stakeholder management skills.
- Ability to collaborate across engineering, product, architecture, and business teams.
- Experience mentoring and guiding less experienced engineers.
- Ability to manage technical risks and strengthen platform controls.
- Strong understanding of enterprise technology strategy and cloud architecture.
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical discipline.
Sourced from foundit
Skills
containerised infrastructureKubernetesRetrieval Augmented GenerationBedrockPrompt EngineeringAuroraaws iamamazon web servicesaws cloudformationMCPIstiovLLMAsynchronous ProgrammingGolangAWS EKSADKA2A protocolsEnvoyService mesh technologiesPythonJavaLanggraphLangchainAgentic AiGenerative AiFastAPIGPU Scheduling