Key job responsibilities
As a Senior Product Manager – Technical for MARS (Model Accelerator and Recommender Service), you will own the product vision, strategy, and roadmap for Amazon's hardware-agnostic model optimization and benchmarking platform. MARS automatically optimizes, containerizes, and recommends optimal hosting configurations for LLMs across heterogeneous compute (Inferentia2, Trainium, and GPU), driving significant inference cost reduction and throughput gains for teams across the organization.
You will
Define and drive the multi-year MARS product roadmap, translating cost-optimization and capacity goals into prioritized, measurable deliverables.
Partner with science and engineering to expand MARS capabilities—new hardware backends, quantization and distillation techniques, and automated benchmarking.
Work backwards from internal customers (model hosting, search ranking, catalog enrichment) to identify high-leverage optimization opportunities and unblock adoption.
Establish the MARS operating model, intake process, and prioritization framework to scale the platform as a shared service.
Own key business metrics—cost per million tokens, GPU/accelerator utilization, throughput, and realized IMR savings—and report progress to senior leadership.
Drive cross-org alignment across partner teams and lead the roadmap workshop cadence.
Manage stakeholder communication, technical trade-offs, and go/no-go decisions across the platform lifecycle.
A day in the life
1. Prioritize the MARS backlog and refine requirements with engineering and science partners.
2. Review benchmarking results, optimization performance data, and cost/utilization dashboards to inform decisions.
3. Engage internal customer teams to capture needs, resolve blockers, and drive platform adoption.
4. Lead or attend standups, roadmap workshops, and cross-org syncs; document decisions and action items.
5. Triage incoming optimization requests through the intake process and set expectations on timelines.
6. Write and update product documents (PRFAQs, roadmap artifacts, execution plans).
7. Track KPIs, escalate risks, and communicate progress to stakeholders and leadership.
5+ years of product or program management, product marketing, business development or technology experience
Bachelor's degree
Experience with feature delivery and tradeoffs of a product
Experience owning/driving roadmap strategy and definition
Experience with end to end product delivery
Experience contributing to engineering discussions around technology decisions and strategy related to a product
Experience with AI/ML technologies
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 151,200.00 - 204,600.00 USD annually
