What you’ll be doing
Design, build and operate hosted Spark service control plane on Kubernetes: the Java REST API, the Spark Connect runner, Kyuubi, and deployment using Helm charts and Flux
Own code review for one or more services end to end and keep them releasable on the release train
Extend the cuDF Spark runtime and the CPU/GPU workload router in Scala and Java, including interoperability with Delta Lake, Apache Iceberg and Unity Catalog
Investigate production failures on clusters running more than a thousand concurrent jobs together with the customer team and upstream library teams, and drive fixes to closure
Instrument metrics, dashboards and alerts; take part in the on-call rotation and keep the runbooks current
Provide recommendations and feedback to teams regarding decisions surrounding topics such as infrastructure, continuous integration and testing strategy
What we need to see
BS, MS, or PhD in Computer Science, Computer Engineering, or a closely related field (or equivalent experience)
9+ years of experience in software development
Strong distributed-systems fundamentals and proficiency in Java or Scala, plus C++ or Python
Hands-on experience operating services on Kubernetes, on-premise or cloud
Experience owning or reviewing a long-lived server: REST front ends, proxies or request routers, JDBC or Thrift services
Experience supporting enterprise or internal production customers, including on-call
Experience using AI tools in software development
Ways to stand out from the crowd
Apache Spark internals, Spark Connect, or Kyuubi
Delta Lake, Apache Iceberg or Unity Catalog integration work
GPU data processing with cuDF, or CUDA experience
Significant contributions to data platform projects committed to collaboration and shared development (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion)
Widely Is considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 184,000 USD – 287,500 USD.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
