Design the correctness and verifiability layer: ground agent output in authoritative sources, catch fabrication, and define when a workflow escalates to human review
Lead projects requiring work from multiple engineers, including agent orchestration patterns, evaluation frameworks, bidirectional XML transformation, and developer-facing authoring tools
Turn content quality evaluations into feedback signals that measurably improve agent behavior, and influence architectural decisions in adjacent systems your services depend on but don't control
Raise the engineering bar through design reviews, exemplary code, and mentoring engineers newer to production AI systems, while identifying root causes of systemic issues and balancing delivery speed against long-term system quality
A day in the life
You'll start with yesterday's agent runs - did the research agent find the right sources, did the writing agent produce content that passes style review? You're asking whether the orchestration architecture still holds as model capabilities shift.
Mid-morning, a service team needs documentation generated from a model type your pipeline doesn't handle. Neither the product shape nor the approach is obvious, so you design the pattern and prototype it.
After lunch, a partner team's API redesign affects how your agents integrate. You influence that design to serve both human and agentic workflows - building consensus without owning it.
About the team
The Applied Science team builds the AI-powered tools that are fundamentally changing how AWS documentation gets created. We develop and operate multi-agent content generation systems, intelligent code-review analyzers, developer-facing authoring tools, and the telemetry infrastructure that measures it all.
Our tools are used daily by hundreds of contributors across AWS. We move fast — shipping improvements weekly — while maintaining the reliability that production content systems require. The team values pragmatic engineering, measurable impact, and the intellectual honesty to know when an AI approach isn't working and to try something else.
We're part of TCX Engineering, the organization behind the AWS Documentation website and the AI-first content platform powering it. You'll work closely with product managers, content strategists, and peer engineering teams building the broader platform infrastructure.
5+ years of non-internship professional software development experience
5+ years of programming with at least one software programming language experience
5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience as a mentor, tech lead or leading an engineering team
Master's degree in computer science or equivalent
5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, NY, New York - 184,900.00 - 250,200.00 USD annually
