Senior AI Evaluation Engineer – QA

PwC

. Analyze complex problems, mentor others, and maintain elevated standards while collaborating with multidisciplinary teams to support AI-enabled client solutions .

Posted 5/22/2026full-timeTampa • Florida, Illinois, North Carolina, Ohio • 🇺🇸 United StatesSenior💰 $55,000 - $151,470 per yearWebsite

About the role

Key responsibilities & impact

Analyze complex problems, mentor others, and maintain elevated standards while collaborating with multidisciplinary teams to support AI-enabled client solutions
Apply automated testing and governance controls effectively
Analyze complex issues and provide actionable insights
Mentor and guide junior associates in their tasks
Uphold rigorous standards of quality and technical excellence

Requirements

What you’ll need

Bachelor's Degree in Computer Science, Data Processing/Analytics/Science
At least 2 years of experience in data engineering, AI/ML engineering, or quality engineering
In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college
Demonstrating three years of specialized training in technology preferred
Experience with test automation and CI/CD pipelines
Familiarity with LLMs and prompt engineering concepts
Understanding enterprise data patterns and quality frameworks
Building and maintaining automated test suites for AI agents
Validating integrations with Power Automate platform
Executing LLM evaluation frameworks using defined metrics
Working with data scientists and ML engineers
Upholding professional standards and documentation expectations

Benefits

Comp & perks

medical
dental
vision
401k
holiday pay
vacation
personal and family sick leave
annual discretionary bonus

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringAI engineeringML engineeringquality engineeringtest automationCI/CD pipelinesLLMsprompt engineeringautomated test suitesintegration validation

Soft Skills

mentoringcollaborationproblem analysisactionable insightsquality standardstechnical excellence

Certifications

Bachelor's Degree in Computer Sciencespecialized training in technology