What You’ll Do
Design, develop and maintain automated test suites and frameworks for distributed, cloud-based systems
Maintain and extend the agentic test generation and analysis tooling built into our major testing frameworks
Build AI-powered workflows and agent skill files that automate manual test toil, such as test data setup, failure triage and release validation
Maintain eval suites, golden datasets and scoring pipelines for our AI agents, scoring correctness, tool use, trajectory, faithfulness, safety, latency and cost
Enforce CI eval gates so that every change to prompts, models, tools or orchestration is measured before release, and feed production failures back into the eval sets
Detect and mitigate unreliable AI output, including hallucinated assertions, flaky or redundant tests, incorrect failure triage and judge bias
Design, run and analyze performance, load and stress tests to find bottlenecks and validate scalability across distributed services
Validate the integration of platform systems, services, data and applications, as well as customer-facing features end-to-end
Review product, system and agent designs for testability, evaluability, flaws and improvements
Share knowledge and contribute to the team's quality and evaluation standards
What You’ll Use
Languages: Java, Node.js, Python, Go
Data & Messaging: MongoDB, MinIO, RabbitMQ, Kafka
Cloud & Infrastructure: AWS (EC2, S3, DynamoDB), Docker, Nomad, Terraform, Unix/Linux
CI/CD & Tooling: Git, Jenkins, GitLab CI/CD, Jira, Bitbucket
Performance Testing: Locust, k6
AI/Agentic & Evals: LLM APIs, agent frameworks and LLM eval tooling
What You’ll Need
Degree in Computer Science or equivalent experience (OOP, data structures, algorithms, distributed systems)
5+ years in software quality, including 3+ years of hands-on SDET or test automation development
Strong programming skills in at least one of Java, Node.js or Python, with Python preferred for eval and agent work
Proven experience designing, building and maintaining test frameworks integrated with CI/CD pipelines (e.g., Jenkins, GitLab CI/CD)
Experience testing web services and APIs (REST, gRPC, JSON)
Hands-on experience with performance and load testing using tools such as Locust or k6, including designing realistic workloads and interpreting results (latency percentiles, throughput, error rates)
A skeptical, verification-first mindset toward AI output, with a clear sense of when to use deterministic assertions and when to use probabilistic evaluation
Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and drive business outcomes.
Bonus Points
End-to-end eval-driven development experience, including release gating, trajectory and tool-use evals, and calibrating LLM-as-judge against human review
Prompt engineering and context or tool design for agents
Integrating performance tests into CI/CD and using observability tools (e.g., Grafana, Prometheus, CloudWatch)
Background in cybersecurity, threat intelligence, malware analysis or sandboxing/detonation environments
#LI-Remote
#LI-KM1
Benefits of Working at CrowdStrike
Market leader in compensation and equity awards
Comprehensive physical and mental wellness programs
Competitive vacation and holidays for recharge
Paid parental and adoption leaves
Professional development opportunities for all employees regardless of level or role
Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections
Vibrant office culture with world class amenities
Great Place to Work Certified™ across the globe
CrowdStrike is proud to be an equal opportunity employer. We are committed to fostering a culture of belonging where everyone is valued for who they are and empowered to succeed. We support veterans and individuals with disabilities through our affirmative action program.
CrowdStrike is committed to providing equal employment opportunity for all employees and applicants for employment. The Company does not discriminate in employment opportunities or practices on the basis of race, color, creed, ethnicity, religion, sex (including pregnancy or pregnancy-related medical conditions), sexual orientation, gender identity, marital or family status, veteran status, age, national origin, ancestry, physical disability (including HIV and AIDS), mental disability, medical condition, genetic information, membership or activity in a local human rights commission, status with regard to public assistance, or any other characteristic protected by law. We base all employment decisions--including recruitment, selection, training, compensation, benefits, discipline, promotions, transfers, lay-offs, return from lay-off, terminations and social/recreational programs--on valid job requirements.
If you need assistance accessing or reviewing the information on this website or need help submitting an application for employment or requesting an accommodation, please contact us at recruiting@crowdstrike.com for further assistance.
CrowdStrike Canada ULC is committed to equal pay for equal work in its compensation practices. The base salary range for this position in Canada is $120,000 - $170,000 CAD per year + variable/incentive compensation + equity + benefits. A candidate’s salary is determined by various factors including, but not limited to, relevant work experience, skills, certifications and location.

This is Canadian-based employment, and it is expected that all employees maintain legal entitlement to work in Canada. Applicants selected to move forward in the hiring process are subject to background checks, including but not limited to criminal record, credit, and/or reference checks.
