Define product-quality evals with engineering that measure usefulness, trust, and reliability, and own the call on whether an experience meets the bar to ship.
Decide with engineering and ML when to use frontier models, when to route across models, when to bring in a new model, and when a model of our own is worth building.
Understand the cost to serve each workflow, and work with growth and finance on how usage is metered and what the unit of value is.
Set up the data loops that improve quality, including what we collect, how we label it, and how it feeds evals and model work.
Design agentic experiences that work in real multiplayer sessions, where people need to understand, steer, and correct what the agent does.
Talk with users every week and bring what you learn back into the work.
Work with design, engineering, marketing, sales, legal, and security teams to align on shipping decisions.
Share what you learn across the product organization so other teams can adopt the practices that work.
WHAT YOU’LL BRING
7+ years in product management, including shipping at least one AI product from concept to real users.
Recent hands-on experience building agentic or LLM-based products, including what went wrong and what you changed.
Technical fluency to design and read evals, and to work as a peer with engineers and ML engineers on context management, latency, reliability, and failure modes.
Sound judgment on model decisions: comparing models, routing across them, adopting new ones, and deciding when fine-tuning or a custom model is worth it.
Understanding of AI unit economics, including cost to serve, usage-based metering, and how model choices change margin.
A record of launching, rebuilding, changing direction, and killing ideas based on evidence
Comfort making high-stakes decisions with incomplete information, and being candid about the tradeoffs.
Experience owning outcomes while partnering with expert engineering and design leaders as true counterparts.
Experience creating structure where no playbook exists.
Experience with collaboration or productivity software.
Experience with forward-deployed or customer-embedded product work.
Experience with agent interoperability, including MCP.
Equal Opportunity
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.