
Software Quality Assurance Engineer – AI Agents
Lucidya | لوسيديا
full-time
Posted on:
Location Type: Remote
Location: Egypt
Visit company websiteExplore more
About the role
- **Why We’re Hiring**
- The AI Agents unit operates at the intersection of **AI behavior, backend systems, APIs, and user experience**. Unlike traditional SaaS features, AI agents introduce new quality dimensions; such as consistency of responses, edge-case handling, workflow reliability, and system resilience under real-world usage.
- We need a QA Engineer who can:
- - Own quality across AI-driven workflows and agent-based systems
- - Balance manual, exploratory, and automated testing
- - Validate complex backend and API integrations
- - Help define quality standards for AI agent deployments at enterprise scale
- What You’ll Do (Key Responsibilities)AI Agent Quality & Test Strategy
- - Partner with product, AI, data, and engineering teams early (“shift-left”) to define acceptance criteria, test scenarios, and quality benchmarks for AI agents.
- - Participate in requirement discussions to assess testability, risks, and edge cases specific to AI-driven behavior.
- - Help define what “good quality” means for AI agents (reliability, fallback behavior, latency, error handling, consistency).
- Manual & Exploratory Testing
- - Execute manual and exploratory testing for AI agent workflows, integrations, and end-to-end scenarios.
- - Validate agent behavior across happy paths, edge cases, failure states, and real-world enterprise use cases.
- - Conduct regression testing across multiple agents, channels, and environments.
- - Validate cross-browser and cross-device behavior for agent-facing UIs (web and mobile where applicable).
- Automation & CI/CD
- - Design, build, and maintain automated test suites (UI, API, end-to-end), with **Playwright preferred**.
- - Extend automation frameworks to support agent workflows, conversational paths, and backend orchestration.
- - Integrate automated tests into CI/CD pipelines and collaborate with DevOps to ensure reliable releases.
- API, Backend & Non-Functional Testing
- - Perform deep API and backend workflow testing to ensure AI agents interact correctly with internal and external systems.
- - Support performance, load, and reliability testing—especially for concurrent agent usage and peak enterprise loads.
- - Assist in security testing initiatives for AI agent integrations and data flows.
- - Support test data strategies across environments, including realistic AI scenarios.
- Quality Governance & Reporting
- - Log, track, and triage defects; collaborate closely with engineers and AI teams to reproduce and resolve issues.
- - Provide release readiness assessments, risk analysis, and defect trend reporting for agent deployments.
- - Advocate for usability, accessibility, reliability, and enterprise-grade quality across the AI Agents portfolio.
- Continuous Improvement
- - Contribute to QA best practices, standards, and documentation tailored to AI agent systems.
- - Help evolve testing approaches for AI-driven products (e.g., exploratory heuristics, scenario-based testing).
- - Stay current with modern QA trends, including AI-assisted testing, automation improvements, and cloud testing tools.
Requirements
- **Skills & Qualifications**
- - Bachelor’s degree in Computer Science, Engineering, or a related field.
- - 2–5 years of experience in QA engineering (manual + automation).
- - Programming/scripting experience in Python, JavaScript, or Java.
- - Automation experience with Playwright is a strong plus.
- - Proven experience in API testing (required).
- - Experience with Git, CI tools (Jenkins, GitHub Actions, GitLab CI), and defect tracking tools like Jira.
- - Exposure to performance/load/security testing tools (JMeter, Locust, OWASP ZAP) is a plus.
- - ISTQB or equivalent certification is a plus.
- - Strong English communication skills.
- - Strong organisational and time-management skills across multiple projects.
- - Ability to work independently with moderate supervision.
- - Comfortable giving and receiving structured feedback.
- - Willingness to join infrequent rotational weekend support for critical issues.
- - Adaptable to changing product priorities and organisational structures (pods/squads or QA-as-a-service).
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
QA engineeringmanual testingautomated testingAPI testingPythonJavaScriptJavaPlaywrightperformance testingload testing
Soft Skills
strong English communicationorganisational skillstime-management skillsindependent workstructured feedbackadaptability
Certifications
ISTQB