Establish evals that matter: offline rubrics, simulated scenarios, safety tests, cost/latency tradeoff suites, and LLM‑as‑judge (with calibrated human review) wired into CI/CD and experiment platforms.
Drive automation at scale: partner with Product/Design/Operations on coverage, policy alignment, localization, and rollout strategy to better customer experience and reduce cost per contact.
Mentor/principal‑lead multiple pods; set technical strategy and quality bars; coach senior engineers on agentic patterns, reliability, and experiment velocity.
Basic Qualifications ----
10+ years building production ML/AI systems; 4+ years leading complex ML initiatives end‑to‑end.
Deep expertise in LLM‑driven systems (inference optimization, prompt/program design, fine‑tuning, distillation/LoRA, safety/guardrails, evals).
Strong software engineering in Python plus one of Go/Java/C++; hands‑on with microservices, gRPC/HTTP, cloud infra, containers, CI/CD, and real‑time telemetry/observability.
Demonstrated ownership of high‑availability services (SLO/SLA design, incident response, on‑call leadership, postmortems).
Track record of shipping customer‑facing intelligent experiences with measurable impact (A/B testing, metrics literacy).
Preferred Qualifications ----
Agentic architectures in production (planner/executor, memory, multi‑step reasoning) and RAG over complex, policy‑heavy knowledge bases.
Experience building support automation for large consumer platforms (routing, policy codification, internal tooling, co‑pilot/auto‑resolve).
Multilingual NLU/NLG (code‑switching, low‑resource languages), hallucination mitigation, safety red‑teaming, and privacy‑by‑design.
Practical expertise balancing speed and reliability at scale: experiment frameworks, feature flags, canary/guarded rollouts, and clear kill‑switches.
For San Francisco, CA-based roles: The base salary range for this role is USD $267,000 per year - USD $297,000 per year.
For Sunnyvale, CA-based roles: The base salary range for this role is USD $267,000 per year - USD $297,000 per year.
For all US locations, you will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. All full-time employees are eligible to participate in a 401(k) plan. You will also be eligible for various benefits.