Whole-Page Quality & Evaluation: Develop LLM-based quality judges, automated evaluation frameworks, and defect detection models to assess end-to-end Search experiences, identify recurring quality issues, and drive measurable improvements.
ML Experimentation & Production Systems: Design scalable model training, evaluation, and inference pipelines; conduct offline and online experiments; and deploy and monitor ML models in production.
Cross-Functional Collaboration: Independently drive complex ML projects from design through production, partnering with ML Infrastructure, Backend Engineering, Data Science, and Product teams to deliver measurable customer impact.
Basic Qualifications
5+ years of professional software engineering experience, including hands-on development and deployment of production ML systems.
Strong proficiency in Python and modern ML frameworks such as PyTorch or TensorFlow.
Solid foundation in machine learning, deep learning, algorithms, and scalable software engineering.
Experience developing, training, and evaluating ML models using large-scale datasets.
Proven ability to independently deliver ML solutions from problem formulation and experimentation through production deployment.
Experience with model evaluation, performance analysis, and offline or online experimentation.
Preferred Qualifications
Experience with large language models, generative AI, and training techniques such as CPT, SFT, or RL.
Experience with large-scale Search, recommendation, information retrieval, or ranking systems.
Familiarity with LLM-based evaluation, automated quality assessment, or defect detection.
Experience with distributed ML training, inference optimization, or production ML infrastructure.
Demonstrated ability to collaborate across engineering teams, lead technical projects, and mentor other engineers.
For San Francisco, CA-based roles: The base salary range for this role is USD $202,000 per year - USD $224,000 per year.
For Seattle, WA-based roles: The base salary range for this role is USD $202,000 per year - USD $224,000 per year.
For Sunnyvale, CA-based roles: The base salary range for this role is USD $202,000 per year - USD $224,000 per year.
For all US locations, you will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. All full-time employees are eligible to participate in a 401(k) plan. You will also be eligible for various benefits.