US: $147000 - $210000 (USD) + 15% bonus target + equity + benefits
Learn more about benefits at Google.
Design comprehensive reward objectives to balance factuality with overall response helpfulness and quality in alignment with performance goals.
Build automated workflows to audit search prompts and identify opportunities for continuous factuality self-improvement.
Facilitate smooth large-model upgrades and orchestrate model fine-tuning focused on factuality.
Address complex loss patterns systematically using established factuality taxonomies to achieve targeted quality improvements.
Write product or system development code.
Minimum qualifications
Bachelor’s degree or equivalent practical experience.
2 years of experience with software development in one or more programming languages.
1 year of experience with Large Language Models (LLMs) and building quality.
1 year of experience building and deploying recommendation systems models (retrieval, prediction, ranking, personalization, search quality, embedding) in production.
Experience integrating generative AI tools or LLM interfaces into workflows.
Preferred qualifications
2 years of experience with data structures and algorithms.
Experience applying statistical inference, confidence intervals, and hypothesis testing to evaluate model changes and prevent overfitting.
Experience balancing precision, recall, latency, and accuracy when configuring prompt architectures.
Experience with prompt engineering, LLMs, and win-loss pattern analysis.
Experience utilizing statistical metrics, ranking losses, and evaluation metrics to score LLM outputs.
Experience developing accessible technologies.
Bachelor’s degree or equivalent practical experience.
2 years of experience with software development in one or more programming languages.
1 year of experience with Large Language Models (LLMs) and building quality.
1 year of experience building and deploying recommendation systems models (retrieval, prediction, ranking, personalization, search quality, embedding) in production.
Experience integrating generative AI tools or LLM interfaces into workflows.