Senior/Staff QA Engineer – Agentic AI Platform

Ontrac Solutions

Senior/Staff QA Engineer for agentic AI platform ensuring product quality and testing AI agent functionalities. Collaborate with teams for the entire application development lifecycle.

Posted 7/30/2026contractRemote • California, Illinois, New York • 🇺🇸 United StatesSenior💰 $80 - $90 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive experience in quality assurance for AI products, with a strong focus on automated testing frameworks, end-to-end QA lifecycle management, and proficiency in JavaScript, TypeScript, or Python for automation scripting.

Highest-signal resume keywords

End-To-End QA Lifecycle ManagementAutomated Testing FrameworksPlaywright ExpertiseJavaScript / TypeScript or Python ProficiencyUI/UX Evaluation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Quality AssuranceAutomated TestingTest Case DevelopmentApplication Development LifecycleAI Agent TestingE2E TestingDefect TriageRegression TestingUsability EvaluationConversational AI Testing

Tools & Technologies

PlaywrightGitJiraGitHub ActionsGitLab CIJenkinsDocker

Industry Keywords

AI Product TestingConversational FlowsEdge-Case BehaviorTest Management ToolsProduction Software Testing

Tech Stack

Tools & technologies

DockerJavaScriptJenkinsPythonTypeScript

About the role

Key responsibilities & impact

Support a critical customer engagement as a Senior/Staff QA Engineer.
Own quality end-to-end for a fast-moving agentic AI product.
Work closely with the Delivery Lead/Solutions Architect and customer engineering stakeholders to ensure product quality from initial test planning through final release.

Requirements

What you’ll need

5+ years of professional QA experience, with at least 2+ years at a senior or staff level.
Demonstrated experience testing production software through a full Application Development Lifecycle (ADLC).
Strong understanding of the Application Development Lifecycle — from requirements through release and support.
Solid UI/UX understanding, with the ability to evaluate usability and flag design/interaction issues, not just functional bugs.
Hands-on experience testing AI Agent use cases — including conversational flows, agent decision-making, tool/function calling, and edge-case or failure-mode behavior.
Proven experience with automated testing frameworks and building maintainable, scalable test suites.
Ability to stand up and manage a Playwright cluster to run automated end-to-end (E2E) testing against a live agent platform.
Ability to independently define clear, well-structured test cases from ambiguous or evolving product requirements.
Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, and sign-off.
Deep expertise with Playwright (including cluster management and parallel execution).
Proficiency in JavaScript / TypeScript or Python for writing automation scripts.
Familiarity with testing LLM outputs, prompt evaluation frameworks, or conversational AI testing tools.
Experience integrating automated test suites into pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization.
Proficiency with Git, Jira, and modern test management tools.

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Ontrac Solutions Website LinkedIn All Job Openings 11 - 50 employees Founded 2010 🤖 Artificial Intelligence 💼 Consulting 🤝 B2B Artificial Intelligence
Consulting
B2B Ontrac Solutions is an AI-first technology services firm that helps organizations design, implement, and scale AI-driven systems, cloud architectures, and enterprise platform integrations. They provide AI strategy and generative AI implementation (including RAG and intelligent search), cloud migration and optimization (multi-cloud architecture, Kubernetes, Terraform, GitOps, and FinOps), data and integration engineering, CRM/CMS/e-commerce platform development, and embedded technical talent / staff augmentation to move AI from experimentation into production. With innovation hubs in Chicago and Karachi, Ontrac focuses on delivering production-ready AI and cloud solutions that drive measurable business outcomes. Senior/Staff QA Engineer – Agentic AI Platform Job not on LinkedIn 🔥 5 minutes ago 🏄 California, Illinois, +1 more states – Remote 💵 $80 - $90 / hour ⏳ Contract/Temporary 🟠 Senior 🔧 QA Engineer (Quality Assurance) Docker JavaScript Jenkins Python TypeScript Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Support a critical customer engagement as a Senior/Staff QA Engineer.
Own quality end-to-end for a fast-moving agentic AI product.
Work closely with the Delivery Lead/Solutions Architect and customer engineering stakeholders to ensure product quality from initial test planning through final release. 🎯 Requirements
5+ years of professional QA experience, with at least 2+ years at a senior or staff level.
Demonstrated experience testing production software through a full Application Development Lifecycle (ADLC).
Strong understanding of the Application Development Lifecycle — from requirements through release and support.
Solid UI/UX understanding, with the ability to evaluate usability and flag design/interaction issues, not just functional bugs.
Hands-on experience testing AI Agent use cases — including conversational flows, agent decision-making, tool/function calling, and edge-case or failure-mode behavior.
Proven experience with automated testing frameworks and building maintainable, scalable test suites.
Ability to stand up and manage a Playwright cluster to run automated end-to-end (E2E) testing against a live agent platform.
Ability to independently define clear, well-structured test cases from ambiguous or evolving product requirements.
Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, and sign-off.
Deep expertise with Playwright (including cluster management and parallel execution).
Proficiency in JavaScript / TypeScript or Python for writing automation scripts.
Familiarity with testing LLM outputs, prompt evaluation frameworks, or conversational AI testing tools.
Experience integrating automated test suites into pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization.
Proficiency with Git, Jira, and modern test management tools. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs SQA – Manual 🕒 Yesterday ProArch 201 - 500 💼 Consulting 🏥 Healthcare 🏭 Manufacturing Website LinkedIn All Job Openings SQA - Manual position executing test plans for healthcare applications. Collaborates with analysts, developers, and clinical SMEs to ensure compliance and validate requirements. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟠 Senior 🔴 Lead 🔧 QA Engineer (Quality Assurance) 🦅 H1B Visa Sponsor Angular JMeter MS SQL Server SQL .NET Hardware Quality Engineer 🕒 2 days ago MillenniumSoft Inc 51 - 200 🎯 Recruiter 🤝 B2B Website LinkedIn All Job Openings Staff Process Engineer (Hardware) defining hardware design processes for a Medical Devices Company. Collaborating across interdisciplinary teams to ensure regulatory compliance and design control documentation. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior 🔧 QA Engineer (Quality Assurance) Test Analyst 🕒 2 days ago PTP 51 - 200 💼 Consulting 🤖 Artificial Intelligence 🤝 B2B Website LinkedIn All Job Openings Test Analyst needed to design and deliver Customer Experience solutions at PTP. Responsibilities include developing test cases and executing tests to meet project deadlines. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior 🔧 QA Engineer (Quality Assurance) Azure SQL TFS Quality Assurance Analyst 🕒 2 days ago Diversified Services Network, Inc. 51 - 200 💼 Consulting 🏛️ Government 🏥 Healthcare Website LinkedIn All Job Openings QA Analyst/Engineer supporting a federal client on a confidential, high-priority initiative. Collaborating remotely with developers and DevOps engineers while maintaining software quality for web applications. 🇺🇸 United States – Remote 💵 $50 - $60 / hour ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior 🔧 QA Engineer (Quality Assurance) Angular Java PHP Senior Lead QA Engineer 🕒 2 days ago Empowers Staffing Inc 11 - 50 💼 Consulting 🎯 Recruiter 🤖 Artificial Intelligence Website LinkedIn All Job Openings 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟠 Senior 🔧 QA Engineer (Quality Assurance) AWS Azure Cloud Google Cloud Platform SDLC View More QA Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Is Remote Rocketship legit? Privacy policy Terms of service Job board SEO course Remote Job Search MasterClass AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs