Help define the APIs that make the data path dynamic, supporting elastic scaling, worker churn and runtime rerouting in production inference clusters.
Bring the region's requirements into NVIDIA's roadmap with enough technical authority to change it.
Grow the local community around NIXL through talks, benchmarks and reference architectures.
What we need to see
M.Sc. or Ph.D. in CS/EE/CE, or equivalent depth earned in industry.
12+ years building or optimizing large scale distributed systems: AI inference or training infrastructure, communication libraries, high performance networking, or HPC runtimes.
Strong systems programming in C++ and Python, with performance critical code shipped.
Hands on experience with RDMA networking (InfiniBand or RoCE) and GPU memory movement.
Working knowledge of modern LLM serving, including prefill/decode disaggregation, KV cache management, tensor and pipeline parallelism, and at least one serving stack (Dynamo, TensorRT-LLM, vLLM, SGLang, Triton).
Strong communication skills, with the technical credibility to be taken seriously by customer engineering teams and by NVIDIA's core library maintainers.
Fluent Mandarin and professional English, and comfortable working across China, Israel and US time zones.
Ways to stand out from the crowd
Open source contributions to NIXL, Dynamo, NCCL, vLLM, SGLang, TensorRT-LLM or Mooncake. We will read your commits.
Inference at genuine scale: thousands of GPUs, multi tenant clusters, strict SLOs.
CUDA, and comfort reading kernel and driver level code when the answer is down there.
A community you've built: a project people adopted, a talk people still cite.
You will help shape how NIXL is adopted across China, working alongside the engineers who design the transport layer itself. The work is public, and disaggregated inference is being defined right now.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.