What you’ll be doing
Shape the architecture of the hardware abstraction layers and core system libraries, and own the API contracts for the components you lead.
Design and implement drivers, runtimes, and data movement and aggregation pipelines that execute workloads on novel silicon.
Build runtime interfaces for launching, monitoring, and managing workloads at production scale.
Drive triage of the most difficult sequencing, initialization, and cross-component runtime failures, and produce root-cause analyses that change how the system is built.
Lead new platform bring-up and NPI for new boards and silicon, in tight partnership with hardware engineering, compiler teams, and data center operations.
Multiply the team — establish the agent-assisted engineering practices, reusable abstractions, diagnostics, and documentation that let everyone move faster without destabilizing the platform.
Communicate architecture and design tradeoffs clearly, in writing and in diagrams, to audiences ranging from individual engineers to executive staff.
What we need to see
MS in CS, CE, EE, or a related STEM field, or equivalent experience, and 12+ years building production system software.
Deep systems-programming expertise, with Rust as your language of choice for low-level work. You have shipped production Rust at the hardware or kernel boundary — drivers, firmware, runtimes, or similar — and you can articulate from experience where Rust earns its keep in system software and where it costs you. We work in Rust from day one; comfort is not enough, we want conviction.
A track record of designing and evolving libraries and APIs meant to be supported for years, including ABI and compatibility discipline.
Fluency in large, multi-repository codebases with layered dependencies.
Demonstrated leadership driving triage of difficult reliability issues to clear, written root-cause analysis.
Low-level platform experience: firmware and boot flows, RTOS, BMCs/MCUs, RISC-V, or closely related system software.
Linux driver or kernel-adjacent experience (for example, VFIO or similar subsystems).
Hardware bring-up and system triage experience: fault analysis, diagnostics, and validation in lab environments.
An established habit: building with AI coding agents — not as a novelty, but as a way you already ship and raise leverage. You can speak to how you design work to be agent-amenable and where you keep humans in the loop.
Ways to stand out from the crowd
Experience having built Rust system software at the scale of a hyperscaler or a Rust-native hardware company — the kind of environment where Rust is the production language for low-level work, not an experiment.
Distributed systems experience: gRPC and RPC frameworks, coordination and telemetry patterns, MPI. Inference systems and token serving experience (vLLM or similar serving and runtime stacks) a huge plus.
Experience shipping and supporting customer-facing SDKs, including documentation and ABI compatibility practices.
Production readiness and delivery depth: CI/CD and release workflows, monitoring and alerting practices, Kubernetes, and data center operational workflows.
Widely considered to be one of the technology world’s most desirable employers, NVIDIA has some of the most forward-thinking and hardworking people in the world inventing the future with us. Are you a creative and collaborative software lead seeking new challenges? If so, we want to hear from you! Join us and help build the real-time, cost-effective AI inference and computing platform that's driving our success in this exciting and quickly growing field.
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 272,000 USD – 431,250 USD.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.