AI Test Engineer II

Trend Health Partners

Validating the quality and safety of AI powered systems at TREND Health Partners. Engaging in AI testing, data validation, and collaboration across teams in a remote environment.

Posted 6/17/2026full-timeRemote • 🇺🇸 United StatesMid-LevelSenior💰 $125,000 - $150,000 per yearWebsite

Tech Stack

Tools & technologies

AWSCloudDistributed SystemsSQL

About the role

Key responsibilities & impact

validating the quality, reliability, and safety of AI powered systems across TREND's platform
AI Testing & Validation
Design and execute test strategies for AI/ML models, including functional, regression, and scenario-based testing
Validate accuracy, consistency, and reliability of AI-generated outputs
Develop test cases for edge cases, model drift, and unexpected behavior scenarios
Evaluate model performance against defined success criteria and business requirements
Test agent-driven workflows and validate interactions between AI agents, APIs, and downstream systems
Identify failure points in end-to-end AI workflows and recommend improvements
Validate training, validation, and test datasets for completeness, accuracy, and bias risks
Perform data validation testing across pipelines to ensure integrity of inputs and outputs
Partner with Data Engineering to detect anomalies
Build and maintain automated test frameworks for AI-enabled systems
Integrate testing into CI/CD pipelines to enable continuous validation
Help define and validate guardrails for AI systems

Requirements

What you’ll need

Bachelor’s degree in Computer Science, Data Science, Engineering, or related field (or equivalent experience)
Experience in QA, testing, or a related engineering role
Experience testing APIs, data pipelines, or distributed systems
Strong understanding of software testing principles and test automation
Experience working in Agile development environment
Familiarity with AI/ML concepts (model evaluation, training vs inference, prompt behavior, etc.)
Experience with test automation tools
Strong SQL/data validation skills
Experience working with cloud-based systems (AWS or Databricks preferred)
Ability to analyze system behavior and identify root causes

Benefits

Comp & perks

competitive salaries
highly valued health insurance
a 401(k) plan with employer match
paid parental leave
more

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI TestingValidationTest strategiesFunctional testingRegression testingScenario-based testingData validation testingTest automationSQLModel evaluation

Soft Skills

Analytical skillsProblem-solvingCollaborationAttention to detailCommunication