KEY RESPONSIBILITIES
Design and implement automation pipelines that support comprehensive testing across multiple environments with varying feature flags and realistic customer data profiles
Create intelligent testing agents that simulate real user behavior to validate different configuration combinations
Develop and maintain GitHub workflows and actions to automate testing, deployment, and validation processes
Manage and optimize Helm charts for deployment consistency across environments
Implement and maintain ArgoCD workflows for continuous deployment and environment management
Establish best practices for testing methodologies and ensure adoption across engineering teams
Build scalable infrastructure that supports parallel test execution across diverse configurations
Develop infrastructure-as-code templates and configurations for reproducible test environments
Implement containerization strategies for test environments and dependencies
Create benchmarking frameworks to measure performance and reliability across different configurations
Monitor and improve test coverage and reliability metrics
Collaborate with product and engineering teams to understand testing requirements and translate them into automated solutions
Troubleshoot and resolve complex testing infrastructure issues
REQUIRED QUALIFICATIONS
5+ years of software engineering experience with a focus on automation and testing infrastructure
Expert proficiency in Python and TypeScript
Extensive experience with GitHub workflows and actions
Deep understanding of testing methodologies and best practices
Experience building and maintaining CI/CD pipelines
Containerization experience (Docker, Kubernetes)
Benchmarking experience and performance testing methodologies
Cloud platform experience (AWS, GCP, or Azure)
Background in developer tools or platform engineering
Ability to design and implement complex automation systems
Strong problem-solving skills and attention to detail
PREFERRED QUALIFICATIONS
Experience working with LLMs in production environments
Familiarity with infrastructure-as-code principles
Experience with container orchestration and management
Knowledge of performance testing tools and frameworks
Experience with monitoring and observability tools
Background in test framework development
Strong working knowledge of Helm charts and ArgoCD
Infrastructure-as-code experience (Terraform, Pulumi, or similar)
WHAT YOU'LL BUILD
You'll enhance our testing platform to allow engineers to
Spin up environments with specific feature flag combinations using infrastructure-as-code
Load test configurations with realistic customer data volumes in containerized environments
Run comprehensive test suites across multiple environment configurations with automated benchmarking
Generate detailed performance and reliability reports across different cloud environments
Automatically detect and flag regressions in diverse usage scenarios
Scale testing infrastructure to accommodate our growing customer base
This is a critical role for ensuring the reliability and scalability of our North platform as we continue to grow our customer base and expand our feature set. You'll have the opportunity to shape the future of our development infrastructure and make a significant impact on product quality. (edited)
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.
