In this role, you will help drive the quality of a product designed to transform brands from invisible warehouses into hyper-personalized, intelligent destinations..
The Cloud Applied AI (AAI) powers business growth with Gemini Enterprise. Our portfolio includes Gemini Enterprise for Customer Experience (Shopping Agent, CX Agent Studio, Agent Assist, Vertex AI Search - Commerce, Customer Experience Insights), along with other vertical and domain packaged solutions. We enable high adoption and speed to value by building solutions that are quickly deployed, delivering new 0-to-1 capabilities with startup agility. Team members operate at the forefront of AI, collaborating directly with model builders with unprecedented speed. Join us to work on cutting-edge projects and shape the future of AI in a fast-paced, collaborative, and impactful environment. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits
Learn more about benefits at Google.
Lead the definition and execution of quality metrics for the Shopping Agent, ensuring response accuracy, safety, and brand alignment across multimodal interactions (text, voice, image).
Design and implement automated evaluation pipelines and "golden datasets" for complex shopping journeys, including virtual try-on, reasoning, and support queries.
Collaborate with research and modeling teams to perform "quality hill-climbing" for foundational models, optimizing prompts and grounding to reduce hallucinations and improve conversion outcomes.
Develop robust integration tests for agentic actions (e.g., add-to-cart, checkout) and ensure seamless interoperability between the Shopping Agent and Customer Service Agent platforms.
Minimum qualifications
Bachelor's degree or equivalent practical experience.
8 years of experience in software development.
5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
5 years of experience leading ML design and optimizing end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
Preferred qualifications
Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures and algorithms.
3 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
Experience with retail workflows (catalog, cart, checkout) and customer support nuances that design user-centric test scenarios.
Experience launching and maintaining high-availability consumer-facing AI products.
Bachelor's degree or equivalent practical experience.
8 years of experience in software development.
5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
5 years of experience leading ML design and optimizing end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).