Complexity and Problem Solving
Works on problems of defined scope where analysis requires evaluation of identifiable factors. Traces an agent failure to its cause (retrieval, tool call, prompt, model, data or infrastructure) using logs and traces, and follows it until it is fixed. Judges whether a metric reflects real quality. Escalates unusual or high-impact issues. Work is reviewed at defined checkpoints.
Collaboration and Interaction
Works with AI engineers, product managers, forward-deployed engineers, platform and security teams. Turns the needs of agent builders into platform features. Explains results, defects and risks to partners who are not familiar with the subject. Asks for guidance early and shares knowledge with the team.
Responsibilities
Evaluation platform (primary focus)
Build platform features for evaluation: dataset creation and versioning, golden datasets, synthetic test data and reusable metric templates
Build scoring for agents: code-based checks, LLM-as-judge, tool-call accuracy and grounding checks
Build human-review features that compare judge scores against human reviewers, and recalibrate when agreement is low
Run evaluations at scale: before release, on every change to a prompt, model or tool, and on agents in production
Build evaluation playbooks so agent builders can evaluate their agents without specialist help
Keep results traceable to the agent, model, prompt and dataset versions tested, with a record of who approved each release
Trust and safety
Build and test the platform's trust controls: agent identity, per-user access to connected systems, tool permissions, guardrails and data boundaries
Run adversarial tests and red-teaming (prompt injection, out-of-scope requests, data-boundary tests), and turn findings into fixes and regression tests
Work with security and governance teams to turn policy requirements into automated checks
Root-cause analysis and quality
Investigate agent failures and performance problems end to end, and follow them until the cause is fixed
Build test and performance tooling: end-to-end agent tests, load and latency tests, and failure diagnostics
Turn production failures and user feedback into regression tests, so the same defect does not return
Quality and responsible practice
Write tested, reviewed and documented code, and contribute to shared libraries and tooling
Test and build to security, data-privacy and responsible-AI requirements
Qualifications
Required
1–4 years in AI/ML or software engineering (internships and applied research count)
Bachelor's degree in computer science, engineering, data science, mathematics or a related field, or equivalent experience
Proficiency in Python, with solid habits: version control, testing, code review. Experience building backend services or platform features
Hands-on experience building, not only using, evaluations or test systems for ML or LLM applications, including reading failures from logs or traces
Working knowledge of LLM applications (prompting, retrieval, agents)
Working knowledge of evaluation statistics (sampling, confidence intervals, variance across runs) and of measuring agreement between reviewers
Ability to write SQL and analyze results
Clear written and verbal communication
Nice to have
Experience building evaluation or observability features used by many teams or at scale
Experience with LLM evaluation and observability tools, and tracing standards such as OpenTelemetry
Experience with red-teaming or adversarial testing of LLM systems
Experience with identity and access (OAuth 2.0, OIDC, delegated access)
Experience with performance, load or test engineering
Experience with agent frameworks, MCP or A2A
Experience with Google Cloud (Vertex AI, GKE) and Kubernetes
Familiarity with AI risk frameworks (NIST AI RMF, ISO 42001)
MS in a related field
What success looks like
Platform features ship on schedule, with tests and documentation
Teams can evaluate their agents on the platform without specialist help
Every agent release carries an evaluation record with criteria, results, open defects and approver
Judge scores agree with human reviewers, and teams use them to make release decisions
Trust controls are enforced by the platform and covered by automated tests
Defects found in evaluation become regression tests, and the same defect does not return
The engineer takes on larger, less defined work each quarter with decreasing guidance
The targeted pay range for this position in the following location is / locations are:
Canada - Toronto Office TRO : 102,000 - 152,000 CAD / Annual
Our pay ranges reflect the minimum and maximum target for new hire pay for the full-time position determined by role, level, and location.The pay range shown is based on our compensation structure in place at the time of posting and may be updated periodically based on business needs. Individual pay is based on additional factors including job-related skills, experience, and relevant education and/or training.
The targeted pay range listed reflects the base pay only and does not include bonus, equity, or benefits. Employees are eligible for bonus, and equity may be offered depending on the position.
Equinix Benefits
As an employee, you become important to Equinix’s success. We ensure all your benefits are in line with our core values: competitive, inclusive, sustainable, connected and efficient. We keep them competitive within the current marketplace to ensure we’re providing you with the best package possible. So, wherever you are in your career and life, you’ll be able to enhance your experience and bring your whole self to work.
Employee Assistance Program: An Employee Assistance program is available to all employees. 
Canada Core Benefits: - Insurance: You may enroll in healthcare coverage that is designed to complement the provincial healthcare system, along with life, disability and optional benefit plans that are designed for you and your eligible family members. - Retirement: You may also enroll in Equinix-sponsored retirement or savings plans: Defined Contribution Pension Plan (DCPP), Group Retirement Savings Plan (RRSP) and Tax-Free Savings Plan (TSFA). - Vacation and Paid Holidays: Equinix offers both vacation and personal time, along with various paid holidays for you to rest and recharge. Eligibility requirements apply to some benefits. Benefits are subject to specific plan or program terms, and to change at Equinix discretion.

Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.
Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.
- We use artificial intelligence in our hiring process. Learn more here.
- 
This posting is a new position within our organization.