PwC

AI Evaluation Engineer – QA Manager

PwC

full-time

Posted on:

Location Type: Office

Location: TampaFloridaIllinoisUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $73,500 - $212,280 per year

About the role

  • Foster a collaborative environment to enhance team performance
  • Uphold professional standards and PwC values in every deliverable
  • Drive innovation in AI technology to meet client needs
  • Supervise team members and support their professional development

Requirements

  • Bachelor's Degree
  • At least 6 years of experience in AI/ML engineering, data engineering, or software engineering
  • In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college
  • Master's Degree preferred
  • Proven experience leading AI solution teams
  • Demonstrating understanding of LLMs and agent architectures
  • Possessing experience with Microsoft Power Platform
  • Bringing prior consulting or professional services experience
  • Establishing testing and validation standards for AI agents
  • Managing and coaching teams for continuous development
  • Building trusted client relationships and translating requirements
  • Designing and overseeing automated testing frameworks for Microsoft Copilot Studio and Google AgentSpace, including unit, integration, end-to-end, and regression testing, as well as low-code workflows, connectors, plugins, and grounding data
  • Leading governance of end-to-end AI agent pipelines and data flows, verifying integration correctness and resiliency, data quality, lineage, transformation accuracy, and embedded automated quality gates across CI/CD pipelines
Benefits
  • medical
  • dental
  • vision
  • 401k
  • holiday pay
  • vacation
  • personal and family sick leave
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
AI engineeringML engineeringdata engineeringsoftware engineeringLLMsagent architecturesautomated testing frameworksunit testingintegration testingregression testing
Soft Skills
collaborationteam performanceprofessional developmentleadershipclient relationship managementinnovationcoachingcommunication