
AI QA Engineer
TeamViewer
full-time
Posted on:
Location Type: Hybrid
Location: Linz • 🇦🇹 Austria
Visit company websiteSalary
💰 €3,843 per month
Job Level
Mid-LevelSenior
Tech Stack
JenkinsPythonSDLCSelenium
About the role
- Design, implement, and maintain automated tests, especially for systems using AI/ML models
- Integrate tests into CI/CD pipelines, monitor regression runs, and adjust strategies for AI components
- Create and maintain comprehensive test plans covering requirements, use cases, and AI-specific quality aspects (performance, accuracy, robustness, fairness)
- Actively contribute to scrum ceremonies, providing feedback from both a user and AI quality perspective
- Collaborate with Product Owners, Tech Leads, Developers, and AI Engineers from use case definition to model refinement to ensure testability
- Assess datasets for quality and bias and evaluate their impact on model behavior
- Apply foundational knowledge of machine learning and statistics to design meaningful tests and interpret AI results
- Drive continuous improvement in QA processes, especially AI-related testing methods
- Work closely with QA colleagues and development teams across units to align on quality standards and address AI-specific challenges
Requirements
- Experience in test automation, software development, or quality assurance, with proficiency in Python or similar languages
- Strong understanding of QA principles, SDLC, and foundational machine learning concepts
- Ability to design meaningful AI/ML test scenarios, focusing on model behavior, edge cases, and reliability
- Knowledge of evaluation metrics and basic statistical methods (precision, recall, F1, AUC, distributions, sampling)
- Experience assessing datasets, including labeling, data quality checks, and identifying bias, data drift, or concept drift
- Familiarity with AI evaluation tools (e.g., MLflow, Weights & Biases) and standard automation or CI/CD tools (e.g., Selenium, GitLab, Jenkins)
- Awareness of ethical AI principles and best practices for responsible AI
- Good communication skills to collaborate with different stakeholders
Benefits
- 28 days of well-deserved holidays
- Onsite Onboarding in our HQ office for an optimal start
- Great compensation and benefits packages including company achievement bonus and stock-based options, regular salary reviews
- Public transport friendly office
- Special terms for local gyms
- Fresh organic fruits, muesli, soft drinks and snacks for free
- Access to Corporate Benefits platform with many discounts
- Regular Team events and company-wide celebrations
- Open door policy, no dress code rules and frequent all Hands
- Hybrid and Flexible work time with up to 50% home office
- Work From Abroad Program allowing up to 40 days of work outside your contracting country
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
test automationsoftware developmentquality assurancePythonmachine learningstatisticsevaluation metricsdata quality checksAI/ML test scenariosstatistical methods
Soft skills
communicationcollaborationfeedbackcontinuous improvementuser perspectivequality standards