AI Quality & Validation Specialist

PingWind Inc. (SDVOSB)

AI Quality & Validation Specialist validating AI-generated results and supporting software testing processes at PingWind. Collaborating with technical teams to ensure quality and compliance with requirements.

Posted 5/26/2026full-timeAnnandale • Virginia • 🇺🇸 United StatesJuniorWebsite

About the role

Key responsibilities & impact

Support functional, regression, and user-focused testing of applications and AI-enabled features before release
Evaluate AI-generated outputs for quality, relevance, accuracy, consistency, and alignment to prompts, instructions, or reference materials
Identify, document, and track software defects, content issues, edge cases, and output anomalies
Perform scenario-based testing by interacting with systems as an end user to validate workflows and expected outcomes
Flag issues in AI or application behavior and provide clear written feedback on what should be corrected or improved
Assist with validation of prompts, workflows, procedures, and output-review criteria used in AI-supported processes
Help review text, image, audio, video, or other generated outputs, as applicable to the program
Maintain test evidence, validation notes, issue logs, and supporting documentation in accordance with project standards
Collaborate with developers, analysts, engineers, and project leadership to clarify expected behavior and support issue resolution
Participate in pilot testing of new features, experimental capabilities, and process improvements
Support continuous quality improvement efforts by identifying recurring issues, trends, and opportunities for better testing coverage
Contribute to the development of repeatable validation procedures, checklists, and quality review practices

Requirements

What you’ll need

1–3 years of relevant experience in software testing, QA support, AI output evaluation, digital content review, or an Associate’s / Bachelor’s Degree in a related field
Strong attention to detail with the ability to identify inconsistencies, defects, or quality issues
Experience documenting findings clearly and communicating actionable feedback
Ability to follow structured instructions, evaluation criteria, and testing procedures
Strong written and verbal communication skills
Comfortable working across multiple tasks in a fast-paced environment
Ability to think from the end-user perspective and test systems against expected outcomes
Basic familiarity with modern software applications, web-based systems, and common collaboration/documentation tools

Benefits

Comp & perks

Eleven Federal Holidays
Paid Time Off accrued each pay period
Parental Leave
Three medical plan choices with generous employer contribution
Dental and Vision Insurance
Company paid Short-Term and Long-Term Disability
Company paid Life and AD&D Insurance
401k with competitive matching and vesting schedule
Continuing education assistance
Medical, Dependent Care and Commuter Flexible Spending Accounts
Employee Assistance Program
Wellness benefits include Calm Health app and WellHub gym subsidy
529 College Savings Plan
Legal Insurance
Pet Insurance

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

software testingQA supportAI output evaluationdigital content reviewscenario-based testingdefect trackingvalidation proceduresquality review practicestest evidence maintenanceissue documentation

Soft Skills

attention to detailclear communicationactionable feedbackstructured instruction followingend-user perspective thinkingmulti-taskingfast-paced environment adaptabilitycollaborationproblem-solvingquality improvement

Certifications

Associate’s DegreeBachelor’s Degree