Senior QA Engineer – GenAI, VoiceAI, Telephony, IVR testing

EXL

Senior QA Engineer responsible for ensuring high-quality delivery of AI-driven voice and conversational systems. Focus on testing GenAI, VoiceAI, Telephony, and IVR systems in a hybrid work environment.

Posted 5/25/2026full-timeNoida • 🇮🇳 IndiaSeniorWebsite

Tech Stack

Tools & technologies

CloudJavaPython

About the role

Key responsibilities & impact

Conduct functional, regression, integration, and system testing for GenAI and VoiceAI-based applications.
Perform IVR testing, including call flows, speech recognition, prompts, routing, and fallback handling.
Validate telephony-related components, including SIP (Session Initiation Protocol), call events, call transfers, call queue logic, and agent workflows.
Ensure AI guardrails (content moderation, safety filters, hallucination checks) are thoroughly tested and validated.
Test conversational flows, voice prompts, LLM responses, ASR (Automatic Speech Recognition), and TTS (Text-to-Speech) output quality.
Develop and maintain test strategy, test plans, test cases, and automation frameworks.
Work closely with product owners, architects, and engineering teams to review requirements and define acceptance criteria.
Ensure adherence to QA best practices and contribute to continuous improvement of processes.
Leverage automation tools for IVR and telephony testing (e.g., BlueJay, Cyara, Empirix, custom automation).
Write and execute automation scripts.
Analyze logs from AI services, telephony servers, call routers, and backend systems.
Document defects, track them to closure, and communicate quality risks proactively.
Provide clear test reports, dashboards, and quality metrics to stakeholders.

Requirements

What you’ll need

8–10 years of experience in software testing.
Hands-on experience in GenAI / LLM testing, prompt validation, response evaluation, and guardrail testing.
Strong experience in VoiceAI systems, ASR/TTS validation, voice bot testing, and multimodal testing.
Proven experience in Telephony and IVR testing—SIP, call flows, routing, voice apps, VXML, CCaaS platforms.
Experience testing cloud-based communication platforms.
Familiarity with conversational design, NLP/NLU testing, and VoiceBot frameworks.
Experience with API testing tools (Postman, REST Assured), log analysis, and debugging.
Good understanding of automation frameworks and scripting languages (Python, Java, or similar).
Strong communication and analytical skills.
Ability to work with cross-functional teams.
Self-driven, detail-oriented, and capable of working in fast-paced environments.

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account EXL Website LinkedIn All Job Openings 10,000+ employees 💰 $2M Venture Round on 2015-01 Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Senior QA Engineer – GenAI, VoiceAI, Telephony, IVR testing 🔥 1 hour ago 🏢🏡 Noida – Hybrid ⏰ Full Time 🟠 Senior 🔧 QA Engineer (Quality Assurance) Cloud Java Python Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Conduct functional, regression, integration, and system testing for GenAI and VoiceAI-based applications.
Perform IVR testing, including call flows, speech recognition, prompts, routing, and fallback handling.
Validate telephony-related components, including SIP (Session Initiation Protocol), call events, call transfers, call queue logic, and agent workflows.
Ensure AI guardrails (content moderation, safety filters, hallucination checks) are thoroughly tested and validated.
Test conversational flows, voice prompts, LLM responses, ASR (Automatic Speech Recognition), and TTS (Text-to-Speech) output quality.
Develop and maintain test strategy, test plans, test cases, and automation frameworks.
Work closely with product owners, architects, and engineering teams to review requirements and define acceptance criteria.
Ensure adherence to QA best practices and contribute to continuous improvement of processes.
Leverage automation tools for IVR and telephony testing (e.g., BlueJay, Cyara, Empirix, custom automation).
Write and execute automation scripts.
Analyze logs from AI services, telephony servers, call routers, and backend systems.
Document defects, track them to closure, and communicate quality risks proactively.
Provide clear test reports, dashboards, and quality metrics to stakeholders. 🎯 Requirements
8–10 years of experience in software testing.
Hands-on experience in GenAI / LLM testing, prompt validation, response evaluation, and guardrail testing.
Strong experience in VoiceAI systems, ASR/TTS validation, voice bot testing, and multimodal testing.
Proven experience in Telephony and IVR testing—SIP, call flows, routing, voice apps, VXML, CCaaS platforms.
Experience testing cloud-based communication platforms.
Familiarity with conversational design, NLP/NLU testing, and VoiceBot frameworks.
Experience with API testing tools (Postman, REST Assured), log analysis, and debugging.
Good understanding of automation frameworks and scripting languages (Python, Java, or similar).
Strong communication and analytical skills.
Ability to work with cross-functional teams.
Self-driven, detail-oriented, and capable of working in fast-paced environments. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs SCADA Tester 🕒 6 days ago Emerson 10,000+ employees 🏢 Enterprise ⚡ Energy ☁️ SaaS Website LinkedIn All Job Openings SCADA Tester working within a testing team to ensure the quality of power plant control systems. Involves performance, functionality, and compatibility testing of software and hardware applications. 🏢🏡 Noida – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🔧 QA Engineer (Quality Assurance) SQL Software Quality Assurance Analyst 🕒 May 14 TELUS Digital 201 - 500 🤝 B2B 🤖 Artificial Intelligence ☁️ SaaS Website LinkedIn All Job Openings Integration Tester ensuring software quality through testing and collaboration with developers at TELUS Digital, a technology consultancy. 🏢🏡 Noida – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🔧 QA Engineer (Quality Assurance) TIDS Software Quality Assurance Analyst 🕒 May 8 TELUS Digital 201 - 500 🤝 B2B 🤖 Artificial Intelligence ☁️ SaaS Website LinkedIn All Job Openings TIDS Software Quality Assurance Analyst implementing process automation and performing web testing throughout client life cycle. Working in a hybrid mode from Noida/Bengaluru office. 🏢🏡 Noida – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🔧 QA Engineer (Quality Assurance) Azure Cloud Senior Software Quality Assurance Analyst 🕒 May 6 TELUS Digital 201 - 500 🤝 B2B 🤖 Artificial Intelligence ☁️ SaaS Website LinkedIn All Job Openings Siebel CRM specialist implementing order management workflows for TELUS Digital. Collaborating with cross-functional teams to ensure system performance and scalability. 🏢🏡 Noida – Hybrid ⏰ Full Time 🟠 Senior 🔧 QA Engineer (Quality Assurance) Cloud Java Cards Tester 🕒 April 29 Expleo Group 10,000+ employees 🚀 Aerospace 🔒 Cybersecurity Website LinkedIn All Job Openings Test Engineers seeking to ensure quality and reliability of software products in cards domain. Collaborating closely with project teams. 🏢🏡 Noida – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🔧 QA Engineer (Quality Assurance) View More QA Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

functional testingregression testingintegration testingsystem testingIVR testingSIPASRTTSautomation frameworksAPI testing

Soft Skills

communication skillsanalytical skillsdetail-orientedself-drivencross-functional teamwork