Define success metrics and quality frameworks for multi-step and conversational AI experiences in Search, spanning task completion, efficiency, trust, and user satisfaction.
Analyze human and auto-rater evaluations of AI experiences alongside behavioral signals to build a holistic view of product quality.
Design and assess live experiments to understand the impact of new AI features on user journeys, and make clear launch recommendations.
Minimum qualifications
Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field.
5 years of experience with analysis applications (e.g., extracting insights, performing statistical analysis, or solving business problems), and coding (e.g., Python, R, SQL) or 2 years of experience with a Master's degree.
Preferred qualifications
Master's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field.
5 years of experience with analysis applications (e.g., extracting insights, performing statistical analysis, or solving business problems), and coding (e.g., Python, R, SQL).
Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field.
5 years of experience with analysis applications (e.g., extracting insights, performing statistical analysis, or solving business problems), and coding (e.g., Python, R, SQL) or 2 years of experience with a Master's degree.