What You’ll Do
Build systems that measure the quality of backend tests beyond coverage, using techniques such as fault detection, mutation analysis and replay of real historical bugs.
Design and build the signals that tell engineers and agents which tests matter for a change, which are reliable, and what a failure means.
Build verification for AI-generated code, including independent test generation, behavioral validation and verification artifacts that CI can attest to.
Define how we evaluate agents, skills and validators that write or check code, using golden datasets, replay of real bugs and regression tracking across models and prompts.
Measure whether our verification signals can be trusted, such as how often judges and validators agree with real outcomes, so humans and agents know when to rely on them.
Reduce flakiness and make failures actionable, so engineers and agents know what failed, how to fix it and who to contact.
Define and track verification health, such as defect catch rate and flake rate, and catch regressions early.
Shape the vision for verification in an agentic world: spec-driven development, independent test generation, and verification evidence that CI can attest to, so human judgment moves from reviewing every PR to defining what correct means.
Contribute to the team's technical direction: write design docs, set standards, mentor engineers and partner with CI, build and product teams.
Basic Qualifications
Bachelor's degree in Computer Science or a related field (or equivalent experience).
8+ years of full-time software engineering experience.
Strong experience building and operating backend distributed systems.
Solid knowledge of algorithms, data structures and system design.
Demonstrated ability to set technical direction on ambiguous, high-impact problems.
Track record of delivering technical work across teams.
Preferred Qualifications
Experience with test infrastructure, CI systems or developer productivity at scale.
Familiarity with test quality techniques such as mutation testing, fault injection, contract testing or flaky test management.
Experience designing evals or benchmarks for LLM or agent systems, with statistical rigor.
Experience applying LLMs or AI agents to developer tooling, code review or test generation.
Experience defining a technical vision and bringing teams and leadership along.
Experience with large monorepos and build systems such as Bazel.
Proficiency in Go or Java.
For San Francisco, CA-based roles: The base salary range for this role is USD $232,000 per year - USD $258,000 per year.
For Sunnyvale, CA-based roles: The base salary range for this role is USD $232,000 per year - USD $258,000 per year.
For all US locations, you will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. All full-time employees are eligible to participate in a 401(k) plan. You will also be eligible for various benefits.
