Key Responsibilities
Test automation development: Build, maintain, and execute automated test scripts for functional, integration, and regression testing using frameworks such as Selenium, Cypress, Jmeter or Playwright.
API testing: Design and execute REST API test cases for application services and AI/model endpoints (request/response validation, contract testing, negative testing).
AI/LLM output testing: Support testing of GenAI and agentic application behavior including validating LLM responses against expected outcomes, checking for consistency, and flagging hallucinations or incorrect outputs using defined test datasets and evaluation criteria.
End-to-end suite development: Contribute to building and extending end-to-end automation suites covering UI, API, and data layers of AI-powered applications.
CI/CD integration: Integrate automated test suites into CI/CD pipelines (Jenkins, GitHub Actions, or Azure DevOps) to enable continuous testing.
Cloud testing: Execute and validate test cases for applications deployed on AWS or Azure environments.
Defect management: Log, track, and triage defects using Jira/HP ALM; collaborate with developers and DevOps engineers to drive issues to closure.
Test documentation & reporting: Prepare test cases, test data, execution reports, and coverage metrics for functional and AI-specific test cycles.
Test strategy support: Assist senior QA engineers and leads in defining test plans and strategies for new AI/GenAI features under their guidance.
Continuous learning: Stay current with evolving AI/LLM testing methodologies, tools, and industry practices, and bring improvement ideas to the team.
Must-Have Skills & Experience (Mandatory)
3+ years of hands-on experience in QA/Test Automation Engineering especially in AI application development.
Strong programming skills in Java or Python for test script development.
Hands-on experience with key automation frameworks: Selenium, Cypress, Jmeter or Playwright.
Solid experience in API testing (REST APIs) using tools such as Postman or RestAssured.
Practical experience in Functional, Integration, and Regression testing.
Experience integrating automated tests into CI/CD pipelines (Jenkins, GitHub Actions, or Azure DevOps).
Working knowledge of Git/GitHub for version control.
Understanding of cloud testing concepts on AWS and Azure.
Foundational understanding of AI concepts, LLMs, and AI-specific testing considerations (e.g., prompt-response validation, output consistency checks).
Familiarity with test/defect management tools such as Jira or HPALM.
Good-to-Have Skills
Exposure to AI/LLM evaluation frameworks and tools (e.g., Ragas, DeepEval, Promptfoo, LangSmith/Langfuse) for automated GenAI output evaluation.
Exposure to testing RAG pipelines, agentic workflows, or conversational AI/chatbot applications.
Performance/load testing experience using JMeter.
DevOps exposure: containerization (Docker) and awareness of Kubernetes for test environment setup.
Awareness of responsible AI testing concepts: bias, fairness, safety, and guardrail validation.
Exposure to GCP in addition to AWS/Azure.
Exposure to Agile/Scrum ways of working.
Qualifications
Education: Minimum Bachelor's degree – B.E./B.Tech/B.Sc. in Computer Science, Information Technology, Electronics, or a related field. Master's degree (M.Tech/MCA/M.Sc.) is a plus.
Certifications (preferred): ISTQB Foundation Level, AWS/Azure/GCP cloud certifications, Agile/Scrum certifications.
Bonus: Personal or academic projects involving test automation, API testing, or AI/LLM application testing.
Qualifications
Bachelors - Computer Science, Bachelors - Mathematics, Bachelors - Software Engineering, Masters - Artificial Intelligence, Masters - Statistics
- Certifications
- BUILD - GENERATIVE AI - Genpact, Certification in Python and Machine Learning - Decodr Technology, Deep Learning Specialization - Coursera, Generative AI & Large Language Models - Databricks Academy, IBM Machine Learning Specialization - IBM
Required Skills API Testing, Application Integrations, Perform Testing, Software Application Testing, Software Quality Assurance (SQA) Testing, Software Test Engineering, Software Testing, Software Testing Life Cycle (STLC), System Integration Testing (SIT), System Testing, Test Case Creation, Test Case Development, Test Development, Test Environments, Test Execution, Testing Methodology, Test Management, Test Scripts, Test Specifications, Unit Testing, User Acceptance Testing (UAT), User Interface Testing, Validation Testing
- Language
- English (Required)
- Language Proficiency -
- English (OVERALL - Proficient - C2)
Additional Job Location -
- Work Shift -
- Day Job (India)
Why join Genpact?
Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter
Make an impact – Help global enterprises solve business challenges that matter
Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead
Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.
Let’s build tomorrow together.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.