What you’ll be doing
Work with customers to design, deploy, and optimize large-scale LLM and Agentic AI inference systems on NVIDIA accelerated computing platforms.
Analyze end-to-end inference workloads and identify opportunities to improve latency, throughput, scalability, resource utilization, and cost efficiency.
Explore and develop solutions for emerging Agentic AI inference challenges, which may include areas such as KV cache management, intelligent routing and scheduling, distributed or disaggregated serving, heterogeneous inference, and large-scale model parallelism.
Build proof-of-concepts, performance studies, and reference solutions to validate new architectures and demonstrate the value of NVIDIA technologies in real-world AI workloads.
Partner with NVIDIA Engineering, Product, Sales, and Business Development teams to solve customer problems, provide product feedback, and help shape technical strategies for strategic AI infrastructure opportunities.
What we need to see
MS or PhD in Electrical Engineering, Computer Science/Engineering, Mathematics, Physics, or a related field, or equivalent practical experience.
3+ years of relevant experience in large language models, AI inference, distributed AI systems, or related areas, with hands-on experience in system design, performance optimization, or large-scale AI workloads.
Strong understanding of modern AI systems and the ability to analyze performance across models, software frameworks, compute, memory, communication, and infrastructure.
Strong programming and problem-solving skills, with experience using common AI frameworks and tools. Proficiency in using AI tools or agents to improve engineering productivity is highly valued.
Clear and structured thinking, strong technical communication skills, and the ability to work effectively with both engineering teams and senior technical stakeholders.
Ways to stand out from the crowd
Experience with Agentic AI or advanced LLM inference optimization, especially for large-scale production workloads.
Demonstrated experience optimizing AI workloads on GPU-accelerated systems or distributed computing platforms.
Familiarity with advanced inference technologies such as NVIDIA Dynamo, TensorRT-LLM, disaggregated serving, heterogeneous inference, expert parallelism, or other large-scale serving techniques.
Experience with NVIDIA AI software and platforms, or with large cloud service providers and production AI infrastructure.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us. If you are creative, autonomous, and passionate about building the next generation of Agentic AI infrastructure, we want to hear from you!
NVIDIA is committed to encouraging a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
