Performance Engineer, Kernels
Sarvam AI · Chennai · onsite · Posted 58d ago
Not disclosed5–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Part of Sarvam's Performance Engineering team. We are hiring two specialized performance roles - Kernels (this posting) and Inference (companion posting). They are a vertical stack: the kernels team authors the µs-level GPU code, and the inference team integrates it into a running serving stack and owns the system-level numbers. If your depth genuinely spans both, apply to either and tell us - but most candidates are strongest in one, and we hire for that depth.
Location: [Bengaluru / Chennai / Hybrid / On-site]
Sarvam serves multiple model families - small and large LLMs, Mixture-of-Experts, streaming Indic ASR, and multimodal - across a multi-node, multi-tenant fleet on H100 / H200 / B200. The Performance Engineering team owns the numbers the rest of the company plans against: how fast we serve, how much it costs, and how much we get out of every GPU. This team works at the intersection of the serving runtime, the kernel layer, and the SRE org that keeps the fleet alive.
About The Role
You will own the kernel layer. Where stock libraries - cuBLAS, cuDNN, FlashAttention, out-of-the-box Triton - leave performance on the table, you will author the custom CUDA, DSL-based, and PTX kernels that close the gap.
This is a hard, narrow, high-leverage role. We hire engineers who have shipped kernels that beat published baselines on real workloads, not engineers who have used kernels. When your code lands, production p99 moves, and you own the explanation of why.
What We're Looking For
Location: [Bengaluru / Chennai / Hybrid / On-site]
- Team: Performance Engineering
- Level: Senior
Sarvam serves multiple model families - small and large LLMs, Mixture-of-Experts, streaming Indic ASR, and multimodal - across a multi-node, multi-tenant fleet on H100 / H200 / B200. The Performance Engineering team owns the numbers the rest of the company plans against: how fast we serve, how much it costs, and how much we get out of every GPU. This team works at the intersection of the serving runtime, the kernel layer, and the SRE org that keeps the fleet alive.
About The Role
You will own the kernel layer. Where stock libraries - cuBLAS, cuDNN, FlashAttention, out-of-the-box Triton - leave performance on the table, you will author the custom CUDA, DSL-based, and PTX kernels that close the gap.
This is a hard, narrow, high-leverage role. We hire engineers who have shipped kernels that beat published baselines on real workloads, not engineers who have used kernels. When your code lands, production p99 moves, and you own the explanation of why.
What We're Looking For
- 5+ years in ML systems, with 2+ years authoring production CUDA kernels. You have a kernel in production that beat the prior baseline by a measurable margin.
- CUDA at kernel-authoring level: thread-block sizing, shared-memory layout, warp primitives, async copies (cp.async, TMA), and MMA selection.
- CUTLASS / CuTe DSL at a modify-and-extend level, with comfort in the layout algebra.
- PTX at a debug-and-modify level - you have inserted hand-written PTX where the compiler missed.
- Nsight Compute and Systems fluency: you read a roofline plot and propose the fix.
- Attention kernels: you have authored or modified at least one (FlashAttention-family, paged, MLA, sliding-window, or sparse).
- Multi-architecture awareness: what changes from Hopper to Blackwell (TMA, WGMMA, tcgen05).
- Communication kernels - NCCL / NVSHMEM authoring, custom collectives, expert-parallel dispatch (DeepEP-style), AFD bipartite comms (StepMesh-style), KV transfer (DualPath / Mooncake). Strongly desired; dedicated comms-specialist headcount is expected later.
- Open-source kernel contributions - FlashAttention, CUTLASS examples, vLLM / SGLang kernels, DeepEP, Mooncake, or non-trivial Triton work. For this role, the GitHub filter is the highest-yield signal.
- tcgen05, TMA, CTA-cluster launch and distributed shared memory, async pipelining, and the FP4/microscaling paths
- Grace-side host-path optimization on GH200 / GB200.
Sourced from foundit
Skills
PTXCuTe DSLNVSHMEMmulti-architecture awarenessCudaTritonNCCLFlash AttentioncuBLAScuDNNCUTLASSNSight Compute
About Sarvam AI
Sarvam AI
Bengaluru
IN
About
Sarvam AI develops AI infrastructure, models, and applications designed to support Indian languages and enterprise use cases. Sarvam AI develops artificial intelligence infrastructure, models, and applications designed to support Indian languages and enterprise use cases. Its platform provides capabilities such as text-to-speech, speech-to-text, translation, document digitization, dubbing, and conversational AI through APIs and deployable products. The company builds and operates a full-stack AI ecosystem that includes foundational models, application-layer tools, and infrastructure for serving AI workloads at scale. Sarvam’s offerings are used by enterprises, government organizations, and developers to automate workflows, process multilingual content, and enable AI-powered interactions across diverse linguistic contexts. The company also develops language and multimodal models tailored to Indian languages and regional requirements, with support for deployment in cloud, private cloud, on-premises, and air-gapped environments.
Industries
Artificial Intelligence (AI)Generative AISoftware