The frontier you will help define is heterogeneous, disaggregated inference, with GPU on prefill and the RDU on decode. That opens hard problems in networking, storage, prompt caching, and tail-latency-bound data movement. Inference systems performance is a young field and most answers are still being discovered, so you will spend your time on ambiguous problems with no established solution, and you will set the technical direction that others build on.
Responsibilities
Define and drive the technical strategy for inference-systems performance including workload capture, benchmarking, modeling, and simulation, while developing and architecture that enables many potential futures
Build the workload-capture and agentic-benchmarking capability - capture representative production traffic and enforce the discipline of interrogating results, spotting artificial contention or misleadingly high cache-hit rates that never occur in real use
Own the performance-modeling and simulation practice - models that predict how a configuration change moves the output, informing capacity planning against customer SLOs and next-generation system and hardware planning
Attack the end-to-end profiling gap - drive tooling that produces accurate, actionable profiles of a distributed inference pipeline so bottlenecks can be localized across host, accelerator, and fabric
Serve as the senior technical voice across model-optimization, systems, hardware, and product, tying together multiple engineering activities and teams, and weighing trade-offs of reliability, scalability, operational cost, and ease of adoption
Act as a resource for the entire organization including representing SambaNova's performance story to customers and partners
Mentor and multiply by raising the capability of principal and senior engineers, building the systems, tools, and patterns that make everyone more productive
Drive the resolution of the most ambiguous, novel challenges that span organizational boundaries or have no established answer in the field yet
Required qualifications
B.S. in Computer Science, Computer Engineering, or Related Field
12+ years of experience in performance engineering, with a demonstrated record of technical leadership on large-scale, complex systems
Deep expertise in end-to-end performance analysis of distributed systems with many moving parts and the ability to localize bottlenecks that others cannot
Proven command of realistic workload generation and simulation and of performance modeling, including calibrating models against real, variable workloads
Demonstrated ability to enter an unfamiliar domain and apply core performance methods with transferable discipline expertise
Ability to lead cross-functional efforts, mentor senior engineers, and influence organizational direction
Experience representing an organizations credibly to customers and partners
Track record of independently scoping and delivering high-complexity, high-ambiguity work with significant impact on products or roadmap
Preferred qualifications
M.S. or PHD in Computer Science, Computer Engineering, or Related Field
Direct experience with LLM inference serving - continuous batching, prompt/KV caching, prefill/decode disaggregation, tail-latency SLOs
Familiarity with inference simulation frameworks or agentic benchmarking efforts
A public technical voice - talks, writing, or community presence on systems performance
Base Salary Range
Base Pay Range
$245,000—$325,000 USD
- Submission Guidelines
- Please note that in order to be considered an applicant for any position at SambaNova Systems, you must submit an application form for each position for which you believe you are qualified.
EEO Policy SambaNova Systems is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard basis of age (40 and over), color, disability, gender identity, genetic information, marital status, military or veteran status, national origin/ancestry, race, religion, creed, sex (including pregnancy, childbirth, breastfeeding), sexual orientation, and any other applicable status protected by federal, state, or local laws.
Benefits Summary for US-Based, Full-Time Employment Positions SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits. We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution. We also offer Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care. Our library of well-being benefits available to you and your dependents includes a full subscription to Headspace, Gympass+ membership with access to physical gyms, One Medical membership, counseling services with an Employee Assistance Program, and much more.
