
AI Evaluation Engineer – QA Manager
PwC
full-time
Posted on:
Location Type: Office
Location: Tampa • Florida • Illinois • United States
Visit company websiteExplore more
Salary
💰 $73,500 - $212,280 per year
About the role
- Foster a collaborative environment to enhance team performance
- Uphold professional standards and PwC values in every deliverable
- Drive innovation in AI technology to meet client needs
- Supervise team members and support their professional development
Requirements
- Bachelor's Degree
- At least 6 years of experience in AI/ML engineering, data engineering, or software engineering
- In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college
- Master's Degree preferred
- Proven experience leading AI solution teams
- Demonstrating understanding of LLMs and agent architectures
- Possessing experience with Microsoft Power Platform
- Bringing prior consulting or professional services experience
- Establishing testing and validation standards for AI agents
- Managing and coaching teams for continuous development
- Building trusted client relationships and translating requirements
- Designing and overseeing automated testing frameworks for Microsoft Copilot Studio and Google AgentSpace, including unit, integration, end-to-end, and regression testing, as well as low-code workflows, connectors, plugins, and grounding data
- Leading governance of end-to-end AI agent pipelines and data flows, verifying integration correctness and resiliency, data quality, lineage, transformation accuracy, and embedded automated quality gates across CI/CD pipelines
Benefits
- medical
- dental
- vision
- 401k
- holiday pay
- vacation
- personal and family sick leave
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI engineeringML engineeringdata engineeringsoftware engineeringLLMsagent architecturesautomated testing frameworksunit testingintegration testingregression testing
Soft Skills
collaborationteam performanceprofessional developmentleadershipclient relationship managementinnovationcoachingcommunication