QA Engineer – GenAI, VoiceAI, Telephony, IVR Testing

EXL

QA Engineer responsible for testing GenAI and VoiceAI systems in a leading data analytics company. Ensuring quality delivery through functional, regression, and system testing.

Posted 5/26/2026full-timeNoida • 🇮🇳 IndiaMid-LevelSeniorWebsite

Tech Stack

Tools & technologies

JavaPython

About the role

Key responsibilities & impact

Conduct functional, regression, integration, and system testing for GenAI and VoiceAI-based applications.
Perform IVR testing, including call flows, speech recognition, prompts, routing, and fallback handling.
Validate telephony-related components, including SIP (Session Initiation Protocol), call events, call transfers, call queue logic, and agent workflows.
Ensure AI guardrails (content moderation, safety filters, hallucination checks) are thoroughly tested and validated.
Test conversational flows, voice prompts, LLM responses, ASR (Automatic Speech Recognition), and TTS (Text-to-Speech) output quality.
Develop and maintain test cases, and automation frameworks.
Work closely with product owners, architects, and engineering teams to review requirements and define acceptance criteria.
Ensure adherence to QA best practices and contribute to continuous improvement of processes.
Leverage automation tools for IVR and telephony testing (e.g., BlueJay, Cyara, Empirix, custom automation).
Write and execute automation scripts.
Analyze logs from AI services, telephony servers, call routers, and backend systems.

Requirements

What you’ll need

5–8 years of experience in software testing.
Hands-on experience in GenAI / LLM testing, prompt validation, response evaluation, and guardrail testing.
Strong experience in VoiceAI systems, ASR/TTS validation, voice bot testing, and multimodal testing.
Proven experience in Telephony and IVR testing—SIP, call flows, routing, voice apps, VXML, CCaaS platforms.
Experience with API testing tools (Postman, REST Assured), log analysis, and debugging.
Good understanding of automation frameworks and scripting languages (Python, Java, or similar).

Benefits

Comp & perks

EXL never requires or asks for fees/payments or credit card or bank details during any phase of the recruitment or hiring process and has not authorized any agencies or partners to collect any fee or payment from prospective candidates.
Job offer will only be extended after a candidate has gone through a formal interview process with members of EXL’s Human Resources team, as well as our hiring managers.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

functional testingregression testingintegration testingsystem testingIVR testingSIPASRTTSautomation frameworksscripting languages

Soft Skills

collaborationcommunicationattention to detailproblem-solvingcontinuous improvement