Implement robust drift monitoring and model retraining processes to maintain accuracy and performance through ongoing performance monitoring.
Define and implement evaluation frameworks for AI/agentic systems, including prompt quality, agent performance, and business outcome metrics.
Collaborate with senior leaders to re-engineer processes by embedding AI into current workflows, driving change and efficiency.
Design, build, and deploy impactful AI and data-driven applications using cloud, data mesh, and knowledge base technologies such as centralized repositories, semantic search, and automated information retrieval systems that organize, store, and provide easy access to critical business data and insights.
Integrate advanced analytics models and applications into operational workflows to ensure business value and adoption.
Communicate analytical findings and recommendations to senior leadership.
Required Qualifications, Capabilities, and Skills
Experience in data science, analytics or a related field.
Proven track record of deploying, operationalizing, and managing AI, ML, and advanced analytics models in a large-scale enterprise environment.
Experience in AI/ML algorithms, statistical modeling, and scalable data processing pipelines.
Experience with A/B experimentation and the ability to develop and debug production-quality code.
Strong written and verbal communication skills, with the ability to convey technical concepts and results to both technical and business audiences.
Scientific mindset with the ability to innovate and work both independently and collaboratively within a team.
Ability to thrive in a matrix environment and build partnerships with colleagues at various levels and across multiple locations.
Proven experience building and deploying multi-agent systems, including use of orchestration frameworks (e.g. LangGraph, ADK), agent design patterns, and production-grade system integration.
Preferred Qualifications, Capabilities, and Skills
Advanced degree (Master’s or Ph.D.) in Data Science, Computer Science, Mathematics, Engineering, or a related field is preferred.