Senior Engineer - AI Platform
NetConnectGlobal · Bengaluru · onsite · Posted 67d ago
Undisclosed7–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Description
Role Overview : We are looking for a Senior Engineer AI Platform to design, develop, and improve enterprise-scale AI infrastructure and platform capabilities. The role combines platform engineering, distributed systems, cloud infrastructure, and Generative AI/Agentic AI, with a focus on building highly scalable, secure, resilient, and high-performance AI platforms.
Key Responsibilities
- Design and develop enterprise-scale AI platform and infrastructure solutions.
- Build highly available distributed systems using active-active and failover architectures.
- Develop high-throughput, low-latency production services and APIs.
- Design and manage cloud-native AI infrastructure across AWS and Kubernetes.
- Build infrastructure supporting LLM and Agentic AI workloads.
- Implement and optimise AI model serving and inference infrastructure.
- Integrate AI platforms with enterprise applications and services.
- Collaborate with architects, product managers, engineers, and business stakeholders.
- Participate in code reviews and promote engineering best practices.
- Implement secure coding, testing, monitoring, and reliability practices.
- Contribute to technology strategy, platform standards, and continuous improvement.
Technical Requirements
- 7+ years of software/platform engineering experience, including 5+ years working with enterprise-scale platform or infrastructure architecture.
- Strong experience with distributed systems, high availability, active-active architecture, and failover patterns.
- Expert-level proficiency in Python, particularly FastAPI and asynchronous programming; Go or Java experience is also valuable.
- Strong AWS experience, including :
- EKS
- Bedrock
- IAM
- Aurora
- CloudFormation
- GPU scheduling
- Multi-tenancy
- Strong knowledge of Kubernetes and containerised infrastructure.
- Experience with service mesh technologies, particularly Istio and Envoy.
- Hands-on experience with Generative AI and Agentic AI, including :
- LangGraph / LangChain
- Google ADK
- MCP
- A2A protocols
- Prompt engineering
- RAG
- vLLM
- Experience building high-performance AI/ML platform infrastructure.
Preferred / Additional Skills
- Experience implementing AI safety and guardrails, including :
- Prompt injection detection
- PII redaction
- Content filtering
- Knowledge of AI security frameworks such as :
- NIST AI RMF
- MITRE ATLAS
- OWASP LLM Top 10
- Strong experience with Envoy Proxy, including xDS API, WASM filters, and AI Gateway extensions.
- Experience with GPU infrastructure and AI inference optimisation.
- Financial services or banking experience, particularly around regulatory requirements, data residency, and compliance.
Leadership & Stakeholder Skills
- Strong analytical and problem-solving capabilities.
- Ability to influence technical direction and architectural decisions.
- Strong communication and stakeholder management skills.
- Ability to collaborate across engineering, product, architecture, and business teams.
- Experience mentoring and guiding less experienced engineers.
- Ability to manage technical risks and strengthen platform controls.
- Strong understanding of enterprise technology strategy and cloud architecture.
Education
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical discipline. (ref:hirist.tech)
Sourced from linkedin
Skills
AI inference optimizationAI Gateway extensionsWASM filtersKubernetesRetrieval Augmented GenerationBedrockPrompt EngineeringMultitenancyAuroraDistributed Systemsaws iamamazon web servicesPlatform engineeringaws cloudformationMCPIstiovLLMOWASP LLM Top 10Asynchronous ProgrammingGolangCloud InfrastructureAWS EKSContent FilteringGPU infrastructureADKA2A protocolsNIST AI RMFEnvoyPythonMITRE ATLAScontainerized infrastructureJavaLanggraphLangchainAgentic AiGenerative AiFastAPIArtificial IntelligenceGPU SchedulingPII redactionxDS APIPrompt injection detectionAI gatewayAI SafetyguardrailsGPUWASM