Backend & Platform Engineer

Role: Backend & Platform Engineer

Function: Backend Engineering / Platform Infrastructure

Location: Bangalore or Mumbai

Type: Full-time

Industry: Artificial Intelligence, Telecommunications, Voice AI, Real-Time Communications

About Company The company is the dedicated AI research arm of a large-scale national intelligence program. It is building foundational AI for India at population scale. Focus areas include Speech-to-Text, Text-to-Speech, Real-Time Conversational AI, and Multilingual Foundation Models. The company invests across the full AI value chain — from next-gen data centers to consumer AI platforms and enterprise enablement. It partners with global AI leaders including OpenAI, Anthropic, Google, and Meta. The mission: make human-machine communication feel as natural as speaking to another person.

Position Overview We're looking for a Backend & Platform Engineer who builds systems that handle millions of concurrent voice streams without breaking a sweat. You will architect the real-time streaming backbone — WebSockets, gRPC, audio chunk orchestration — that connects client-side edge to our core AI inference nodes. High availability isn't a goal here; it's the default setting.

Role & Responsibilities

• Architect and own the real-time streaming backend handling WebSockets and gRPC for live voice sessions
• Build audio chunk orchestration pipelines with ultra-low latency and zero data loss guarantees
• Design and implement seamless state management across distributed, concurrent voice stream sessions
• Engineer low-overhead routing layers between client-side edge nodes and core AI inference clusters
• Integrate RTP/WebRTC protocols into the platform for real-time audio transport and session handling
• Implement distributed caching patterns to minimize latency across millions of simultaneous connections
• Drive platform reliability, observability, and incident response for mission-critical voice infrastructure

Must Have Criteria

• 4–9 years of backend engineering experience building high-concurrency, distributed production systems
• Hands-on experience with Go or Rust for performance-critical backend services (not just familiarity)
• Proven experience building real-time streaming systems using WebSockets and gRPC at scale
• Working knowledge of RTP/WebRTC protocols and audio codec handling (Opus, G.711, or similar)
• Experience implementing distributed caching using Redis for low-latency state management
• Demonstrated ability to architect systems handling 1M+ concurrent connections or equivalent scale
• Experience with container orchestration using Kubernetes for deploying high-availability services

Nice to Have

• Experience building voice or audio infrastructure for a conversational AI or VoIP product
• Prior work at a real-time communications company (Twilio, Agora, Daily.ai, or similar)
• Familiarity with GPU inference serving and optimizing the edge-to-inference handoff latency
• Open-source contributions to networking, audio processing, or distributed systems projects
• Experience operating systems at telco-scale or within high-frequency trading infrastructure

What We Offer

• Opportunity to build voice AI infrastructure that will impact hundreds of millions of Indian users
• Work alongside world-class AI researchers and engineers on frontier real-time AI problems
• Access to massive compute infrastructure including next-gen GPU clusters and edge nodes
• High ownership, fast-moving culture — no bikeshedding, no monolith thinking
• Competitive compensation and benefits within the company's broader ecosystem