As a QA Engineer on our AI product team, you will design and execute testing strategies for both traditional software features and AI-specific behaviors such as model accuracy, hallucination detection, prompt reliability, safety, bias, performance, and user trust. You will work closely with product managers, engineers, data scientists, and designers to validate product quality from concept to production.
This role is ideal for engineers with strong software development fundamentals and a passion for Generative AI technologies.
What You’ll do
Key Responsibilities
Design, develop, and execute test plans for multi-agent systems
Evaluate model behavior across real-world scenarios, edge cases, and adversarial inputs
Test prompt flows, agent behaviors, recommendations, summarization, search, classification, and generative outputs
Identify and document issues related to hallucinations, inaccurate outputs, bias, unsafe content, latency, and poor user experience
Drive scalability, reliability, and operational excellence for production AI systems
Build advanced tool orchestration and workflow automation solutions
Build automated test frameworks for regression testing and continuous quality assurance
Conduct manual exploratory testing for new AI features and workflows
Create evaluation metrics and quality rubrics for AI product performance
Collaborate with ML engineers and product teams to define success criteria for AI features
Monitor production issues, analyze root causes, and drive quality improvements
Perform risk assessments for AI safety, privacy, compliance, and user impact
Maintain test documentation, defect tracking, and reporting to stakeholders
Partner with cross-functional teams to improve product quality and release readiness
What You Need to Bring
Required Skills
7-10 years of software engineering experience.
3+ years testing production-scale Generative AI systems.
Strong understanding of QA methodologies, testing lifecycle, and defect management
Experience with test case design, exploratory testing, and regression testing
Hands-on experience with test automation tools such as Selenium, Playwright, Cypress, Postman, or similar
Familiarity with API testing, SQL/NoSQL basics, and backend validation
Strong analytical and problem-solving skills
Ability to think critically about edge cases and user behavior
Excellent communication and documentation skills
Experience with bug tracking tools such as Jira, Azure DevOps, or similar
Experience testing AI, ML, or GenAI applications
Knowledge of LLM evaluation techniques, prompt testing, RAG systems, or model benchmarking
Familiarity with Python, JavaScript, or automation scripting
Experience with AI safety testing, red-teaming, fairness, or policy evaluation
Understanding of metrics such as precision, recall, latency, user satisfaction, and error rates
Exposure to analytics dashboards, and user behavior analysis
Knowledge of privacy, security, and compliance concerns in AI products
Knowledge of MCP ecosystem expertise.
Knowledge of Multi-agent orchestration platforms such as LangGraph, CrewAI, AutoGen, and OpenAI Agents SDK.
Accessibility
HPE is committed to creating an inclusive and accessible workplace and encourages applications from all qualified individuals, including those with disabilities. If you believe you require accommodation during any stage of the application or interview process, please submit your request by completing our secure form linked here.
Note: This option is reserved for applicants needing assistance/reasonable accommodation related to a disability.
What We Can Offer You
Health & Wellbeing
We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.
Personal & Professional Development
We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.
Unconditional Inclusion
We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.
Let's Stay Connected
Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE.
#india
#hybridcloud
Job
- Engineering
- Job Level:
- TCP_04
HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity.
Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities.
HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.
Recruitment Fraud Alert
We have become aware of an increase in fraudulent recruitment activities in which individuals impersonate our company or authorized recruitment agencies to offer fake employment opportunities. These scams may occur through false websites, emails, social media, or chat-based applications and often aim to obtain personal information or money. Please note that Hewlett Packard Enterprise (HPE), its direct and indirect subsidiaries and affiliated companies, and its authorized recruitment agencies/vendors will never charge a candidate a registration fee, hiring fee, or any other fee in connection with its recruitment and hiring process. We also never request personal information such as back account details, Social Security numbers, or national IDs via social media or chat applications.
All legitimate job opportunities will come through official company channels, and candidates are responsible for verifying the credentials of any third party claiming to represent the company. Any reliance on fraudulent communication is at the individual’s own risk, and HPE disclaims legal liability for any resulting damages. If you suspect recruitment fraud, do not share personal information or make any payments and report the incident to your local authorities immediately.