AI Quality Engineer

PhoenixTeam

AI Quality Engineer designing and validating secure AI solutions for PhoenixTeam’s federal modernization customer. Building testing frameworks, quality gates, and reliable multi-agent workflows.

Posted 9/10/2026full-timeRemote • 🇺🇸 United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing AI-enabled solutions, ensuring quality assurance through automated testing and compliance. Proficient in collaborating across teams to enhance AI capabilities and support federal customer modernization goals.

Highest-signal resume keywords

AI-Enabled Solution DesignAutomated Testing ToolsSoftware Quality AssuranceAWS ExperienceFederal Client Support

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software Quality AssuranceTest EngineeringAI Code ValidationAutomated TestingCI/CD Pipeline FamiliarityJavaPostgreSQLSalesforceData Sensitivity IdentificationDefect Management

Soft Skills

Excellent Communication SkillsCollaboration Across Teams

Tools & Technologies

SeleniumAWS LambdaAWS RedshiftChatGPTClaudeGeminiNotionAirtableZapierLangChain

Certifications & Qualifications

Public Trust Clearance Eligibility

Industry Keywords

Federal Client ExperienceFedRAMP AuthorizationMortgage Industry ExperienceFintech ExperienceAI Safety and Governance

Tech Stack

Tools & technologies

Amazon RedshiftAWSJavaPostgresSelenium

About the role

Key responsibilities & impact

Design and implement AI-enabled solutions for customer modernization use cases
Develop and integrate AI capabilities into existing systems and workflows
Establish and enforce quality assurance frameworks, including test plans, acceptance criteria, and regression suites
Validate AI-generated code, skills, and agents before promotion through the innovation pipeline
Guide development of reusable AI skills and agents for customer modernization tasks
Emphasize automated testing, security scanning, data sensitivity, and scalability
Collaborate with DevOps engineers to create and orchestrate long-running, multi-agent workflows
Ensure reliability, observability, and recoverability in production environments
Support the innovation pipeline moving AI-generated prototypes from sandbox concepts into secure, enterprise-grade applications
Review and quality-check prototype outputs for accuracy, reliability, and standards adherence
Monitor AI-assisted development outputs for accuracy, reliability, and compliance drift
Feed findings back to Value Engineers and AI Engineers to improve prompts, skills, and agents
Support federal customer modernization goals by automating and streamlining servicing operations, reducing manual processing, improving data quality, aligning with modernization standards, and planning for legacy-platform retirement

Requirements

What you’ll need

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent professional experience
Demonstrated experience in software quality assurance, test engineering, or a related discipline, including test plan design and defect management
Hands-on experience testing or validating AI-generated code, prototypes, or “vibe-coded” solutions for accuracy and reliability
Experience with automated testing tools and frameworks (e.g., Selenium) across web and enterprise applications
Experience with Salesforce, AWS (including Lambda and Redshift), Java, PostgreSQL, or a comparable enterprise technology stack
Familiarity with CI/CD pipelines and quality gates within modern software delivery practices
Ability to identify security, data-sensitivity, and compliance risks in AI-assisted solutions
Excellent written and verbal communication skills and ability to work across product, engineering, data, and business SME teams
Must be a U.S. citizen
Eligible to obtain and maintain a Public Trust clearance / favorable suitability determination
Preferred: Direct experience supporting Federal clients
Preferred: Experience with FedRAMP authorization processes
Preferred: Mortgage, fintech, or other regulated industry experience
Preferred: Familiarity with AI safety, governance, and compliance
Preferred: Ability to use or teach tools such as ChatGPT, Claude, Gemini, Notion, Airtable, Zapier, LangChain, or similar
Preferred: Experience in startups, consulting, internal strategy, learning & development (L&D), or innovation teams

Benefits

Comp & perks

100% remote work (US-based)
8-5 ET work schedule
Equal Opportunity Employer