Principal Product Manager, Agentic Evals

Expedia Group

Principal Product Manager leading the development of AI evaluation frameworks at Expedia Group. Collaborating with engineering and product teams to ensure quality and trust in AI experiences.

Posted 7/8/2026full-timeSeattle • California, Washington • 🇺🇸 United StatesLead💰 $224,000 - $313,500 per yearWebsite

About the role

Key responsibilities & impact

Define Expedia Group’s AI evaluation framework, principles, and adoption strategy
Build tools and workflows that support reliable, scalable measurement across brands
Partner with engineering and data science on metric design, instrumentation, and model evaluation
Establish clear, durable standards for accuracy, safety, transparency, and performance
Publish evaluation insights, scorecards, and recommendations that shape roadmaps
Influence strategic decisions on AI investments and risk management
Drive alignment across product, engineering, data science, and platform teams on evaluation strategy, standards, and prioritization
Create governance models that ensure consistency and responsible deployment at scale
Shape cross-team operating models and evaluation practices that guide how AI products are built and deployed across the company

Requirements

What you’ll need

Bachelor's degree in a technical, quantitative, or related field, or equivalent practical experience.
10+ years of product management experience, including significant work with AI, ML, data platforms, or evaluation systems
Strong technical depth and experience partnering with DS/ML teams
Proven ability to build frameworks, metrics, or tools that scale across large organizations
Experience with model evaluation, instrumentation, experimentation, or system reliability
Strong written and verbal communication that brings clarity to complex technical spaces
Track record of influencing cross-functional leaders and driving alignment

Benefits

Comp & perks

medical, dental, and vision coverage
paid time off
an Employee Assistance Program
wellness and travel reimbursement
travel discounts
International Airlines Travel Agent Network (IATAN) membership

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AIMachine LearningData PlatformsMetric DesignInstrumentationExperimentationSystem ReliabilityFramework DevelopmentTool BuildingEvaluation Systems

Soft Skills

Written CommunicationVerbal CommunicationInfluencing SkillsCross-Functional CollaborationClarity in Technical Spaces