Partner with researchers to co-design model architectures and training recipes that are performant at scale (e.g., activation checkpointing strategies, mixed precision, sequence packing).
Extend and contribute to kernel compilers (e.g., Triton, Gluon) to improve iteration speed and enable targeting of custom/non-NVIDIA accelerators.
Build and extend agentic systems that automatically generate, benchmark, and iterate on custom kernels.
Evaluate emerging accelerator architectures (AMD, TPU, SRAM-based ASICs, and other novel hardware) for fit with our training workloads, and lead proof-of-concept ports/benchmarks.
Explore different model/data parallelisms (FSDP, context parallel, expert parallel, etc.) to determine optimal configuration per model size.
Requirements
Bachelor's or Master's degree in Computer Science, Computer/Electrical Engineering, or a related field.
3+ years in AI performance engineering, with significant time leading large-scale performance improvement projects.
Deep understanding of GPU architecture and performance characteristics (memory bandwidth, compute-bound vs. memory-bound ops, occupancy).
Proficiency with profiling tools (Nsight Systems/Compute, PyTorch Profiler, HTA, or similar) and ability to translate traces into concrete optimizations.
Solid grasp of collective communication (NCCL) and modern networking concepts (RDMA, NVLink, InfiniBand/RoCE, topology-aware placement).
Strong Python and CUDA/C++ skills; comfortable reading and modifying framework internals.
Experience debugging performance regressions and instability at scale (stragglers, hangs, OOMs, numerical divergence).
Experience defining and reasoning about hardware-efficiency metrics (MFU/HFU) and using them to drive optimization priorities.
Bonus Qualifications
Experience with heterogeneous or multi-datacenter training setups and cross-cluster orchestration.
Contributions to open-source ML systems projects (PyTorch, Megatron-LM, vLLM, DeepSpeed, JAX, etc.).
Exposure to non-NVIDIA accelerators (AMD GPUs, TPU/Trainium/Inferentia, or custom silicon) and heterogeneous fleet management.
The US base salary range for this full-time position is $200,000 to $400,000 per year.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.