When you apply, please indicate the area of focus that best matches your experience. Strong generalists are welcome; we will place you where your depth is most useful.
What You’ll Do
Operate the GPU fleet end to end across training and serving - provisioning, observability, capacity, and fleet health.
Hold a meaningful on-call rotation, write runbooks that hold up under pressure, and drive postmortems that produce durable fixes.
Build the internal tooling the team relies on, rather than operating off-the-shelf systems alone.
Partner with ML and platform teams to keep large runs alive and serving latency predictable.
What We're Looking For
5+ years in infrastructure or site reliability engineering, including 2+ years operating GPU clusters at scale.*
Demonstrated on-call ownership of infrastructure that mattered, with a track record of postmortems that led to real change.
Proficiency in Python or Go, used to build and maintain internal tooling.
Working fluency across all five areas of focus below - enough to recognize, triage, and route a problem outside your specialty, even if the fix belongs to a teammate.
For the Storage and Fabric areas of focus, we will weigh deep domain expertise against the GPU-cluster requirement; exceptional specialists with less direct GPU-fleet time are encouraged to apply.
Bring depth in one of the five areas below; expect to be conversational across the rest.
1. Distributed high-performance storage — operate a parallel filesystem (Lustre, GPFS, WEKA, or BeeGFS) at scale and keep it from stalling under checkpoint-write storms.
2. Fabric & RDMA networking — InfiniBand or RoCE health, NVLink/NVSwitch topology, and RDMA debugging that catches degradation before the workload feels it.
3. GPU systems reliability — NCCL debugging, driver and firmware lifecycle across a mixed fleet, and DCGM-based node health at scale.
4. Kubernetes platform reliability — the GPU operator stack, scheduling (Slurm-on-k8s or pure k8s), multi-tenant isolation, and cost/SLO primitives.
5. Training & inference workload reliability — hang and straggler detection, checkpoint/restart, and protecting serving p99 with HA and DR.
Bonus Points
Slurm and Kubernetes hybrid environments.
On-premise GPU deployment, including coordination with datacenter operations on power, cooling, and InfiniBand cabling.
Experience with Indian NCPs, DGX SuperPOD, Lambda, CoreWeave, NeevCloud etc.
Multi-tenant GPU isolation (MIG, MPS, time-slicing) in production.
Why Sarvam?
Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.
Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
High ownership and high impact, from day one
Everything we do is AI-first, from the way we build and ship to the way we think about problems
You can work on problems that could change how an entire country learns, works, and communicates
If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.