Senior QA Engineer, AI

TeamViewer

Senior QA Engineer defining automated testing and AI evaluation frameworks for TeamViewer’s digital workplace platform. Testing agentic behavior, safety, performance, and non-deterministic outputs.

Posted 8/7/2026full-timeAustin • Texas • 🇺🇸 United StatesSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and maintaining automated test infrastructures, particularly for AI-powered features and agentic systems. Proficient in evaluating model quality and implementing risk-based testing strategies while collaborating effectively with engineering teams.

Highest-signal resume keywords

Test AutomationPython ProgrammingAI Testing FrameworksCI/CD IntegrationAgentic Systems Evaluation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Test AutomationPython ProgrammingTypeScript ProgrammingJava ProgrammingC# ProgrammingAPI TestingPerformance TestingAutomated Testing PlatformsModel Quality AssessmentFlaky Test Management

Soft Skills

Strong Communication SkillsCollaboration Across Distributed Teams

Tools & Technologies

AI Coding AgentsMCP ToolingEvaluation FrameworksTest Data StrategiesAgentic Development Environments

Industry Keywords

Quality EngineeringAgent-Generated CodeNon-Deterministic SystemsMulti-Step WorkflowsSafety Mechanisms

Tech Stack

Tools & technologies

JavaPythonTypeScript

About the role

Key responsibilities & impact

Own the quality strategy for teams shipping largely agent-generated code
Build and maintain automated test infrastructure across unit, integration, end-to-end, contract, API, performance, and regression testing
Define and operate evaluation frameworks for AI-powered features, including datasets, scoring systems, model-as-judge approaches, human calibration, regression tracking, and release gates
Design testing strategies for non-deterministic and agentic systems
Use AI coding agents to generate and maintain meaningful, risk-based test suites
Test agent behavior, including multi-step task execution, tool usage, failure recovery, safety enforcement, and human handoff workflows
Instrument production quality signals and use real-world feedback to improve evaluation and testing frameworks
Partner with engineering teams throughout the development lifecycle, from refinement through release

Requirements

What you’ll need

8+ years of industry experience in test automation or quality engineering
Strong programming skills in Python, TypeScript, Java, or C#
Track record supporting complex software products
Hands-on experience testing AI and model-based systems, including evaluation frameworks and model quality assessment
Ability to build and scale automated testing platforms, including CI/CD integration, test data strategies, framework development, and flaky test management
Strong understanding of evaluating agentic systems, including tool calling, multi-step workflows, safety mechanisms, and failure handling
Regular use of AI coding agents with critical review and accountability for generated software and test assets
Experience with API testing, performance testing, and at least one of desktop, web, or distributed backend platforms
Deep understanding of AI failure modes, including hallucinations, prompt injection, context degradation, non-determinism, and silent regressions
Practical experience with agentic development environments, MCP or comparable tooling, and repository-based management of prompts, instructions, and evaluation assets
Strong communication skills and ability to collaborate across distributed teams
Passion for helping shape a modern AI-native organization

Benefits

Comp & perks

Competitive compensation and bonuses
Flexible PTO and paid holidays
401(k) with employer matching
Comprehensive Health insurance package including 100% employer-paid medical coverage
Up to 12 weeks of Parental Leave
Basic Life Insurance, Short-Term & Long-Term Disability, 100% employer-paid
Quarterly teambuilding events, leadership luncheons, and companywide “All Hands” meetings
Open door policy and business casual dress code
Opportunities for employees to grow both personally and professionally
Accommodations or adjustments during the application or hiring process, including interview or onboarding support