Build and operate evaluation and quality tooling for AI services; golden datasets, LLM-as-judge and groundedness/hallucination checks, and prompt/agent regression
Own the reliability of shared platform services: monitoring, logging, and observability for model and agent performance and health; and responding to and resolving production issues
Apply the platform’s governance and security controls in the services you build, cost/spend guardrails, connector permission scope, and prompt-injection and agent-attack mitigation
Design reusable, well-documented service abstractions, templates, and SDKs that application and agent teams build on, and partner with those teams to bring new AI capabilities into production and continually improve the experience of building on the platform
Provide constructive code reviews and mentor junior and mid-level engineers to ensure the engineering standards across the platform team
Document platform services, interfaces, and patterns so consuming teams can self-serve, and support knowledge-sharing across the AI CoE
Stay abreast of AI industry trends and proactively identify opportunities for improvement and adoption
Qualifications
Bachelor or Master degree in CS, AI/ML, Data Science, or equivalent practical experience.
5+ years of industry experience in software engineering or ML
Working understanding of agent frameworks and architectures (e.g., LangChain, LangGraph, or CrewAI), sufficient to design, build, and operate the platform services that support them, including RAG and memory
Strong programming skills in one or more languages (e.g., Python, Java, Go, Node.js, or TypeScript), with solid experience building backend services and distributed systems in production, including microservices and event-driven architectures, and designing and versioning REST or GraphQL API contracts
Solid experience using managed cloud services (AWS preferred: Bedrock/AgentCore, Lambda, API Gateway, eventing; GCP or Azure acceptable) to build backend and orchestration services
Hands-on experience operating an agent runtime such as AWS Bedrock AgentCore (or an equivalent) is a strong plus
Hands-on experience building CI/CD pipelines and applying LLMOps/AgentOps practices for deploying, scaling, and monitoring LLM-powered services
Knowledge of LLM/agent evaluation and quality measurement (e.g., golden sets, LLM-as-judge, groundedness/hallucination metrics, regression testing of prompts and agents).
Experience with monitoring/logging stacks such as Datadog, Grafana, or the ELK stack
Working knowledge of vector databases, memory systems, and human-in-the-loop workflows.
Strong collaboration skills across platform engineering and product teams, with clear communication and a bias toward shared standards and reusable solutions
Curious mindset with a strong desire to stay ahead of AI/ML advancements and enterprise best practices
Company Description
Waters Corporation (NYSE:WAT) is a global leader in life sciences and diagnostics, dedicated to accelerating the benefits of pioneering science through analytical technologies, informatics, and service. With a focus on regulated, high-volume testing environments, our innovative portfolio harnesses deep scientific expertise across chemistry, physics, and biology. We collaborate with customers around the world to advance the release of effective, high-quality medicines, ensure the safety of food and water, and drive better patient outcomes by detecting diseases earlier, managing routine infections, and combating antibiotic resistance. Through a shared culture of relentless innovation, our passionate team of ~16,000 colleagues turn scientific challenges into breakthroughs that improve lives worldwide.
Diversity and inclusion are fundamental to our core values at Waters Corporation. It benefits our employees, our products, our customers and our community. Waters complies with all applicable federal, state, and local laws. Qualified applicants are considered without regard to sex, race, color, ancestry, national origin, citizenship status, religion, age, marital status (including civil unions), military service, veteran status, pregnancy (including childbirth and related medical conditions), genetic information, sexual orientation, gender identity, legally recognized disability, domestic violence victim status, or any other characteristic protected by law. Waters is proud to be an equal opportunity workplace and is an affirmative action employer. All hiring decisions are based solely on qualifications, merit, and business needs at the time.