Product Manager, Specialist – Generative AI
Vanguard
full-time
Posted on:
Location Type: Hybrid
Location: Malvern • North Carolina • Pennsylvania • United States
Visit company websiteExplore more
About the role
- Lead product management efforts across one or more strategic domains
- Identify and prioritize high-impact AI use cases that expand the AI assistant’s value to clients and internal stakeholders
- Work with senior product leadership along with peers leading other domain work to evolve its product vision, roadmap, and measurable success outcomes including quality, trust, adoption, and business impact
- Drive initiatives through discovery, feasibility assessment, experimentation, pilot, and scale
- Validate that Generative AI is the appropriate solution versus deterministic or rules-based approaches
- Define measurable quality bars and acceptance criteria for its outputs, including accuracy, completeness, compliance, explainability, and latency
- Establish evaluations for your domain area including ground truth creation, annotation strategies, precision and recall trade-offs, and continuous model monitoring
- Partner with data science and engineering to track model performance, drift, hallucinations, confidence thresholds, and flagged interactions
- Translate model behavior and evaluation results into actionable product decisions and iteration plans
- Continue to work with other product teams to manage human-in-the-loop systems, including review workflows, escalation paths, and confidence gating
- Collaborate closely with Legal, Compliance, Risk, and Data Governance to ensure appropriate disclosures, guardrails, and privacy controls are embedded from inception
- Define acceptable versus unacceptable use cases and ensure outputs align with enterprise standards for safety, transparency, and explainability
- Partner with UX and prompt engineers to design this AI assistant’s conversational experience, reducing ambiguity and supporting recovery from misunderstandings
- Balance accuracy, latency, and client trust in its conversational flows
- Leverage user feedback, flagged conversations, and behavioral metrics to continuously refine the AI assistant’s experience
- Work closely with engineering, data science, UX, legal, compliance, operations, and business stakeholders to align on priorities and deliverables
- Translate strategy into clear requirements, experiments, and execution plans
- Participate in ongoing planning, departmental prioritization activities, and enterprise AI strategy discussions as required
Requirements
- 5 years related work experience
- 2 years of leading large cross-functional teams on major organizational projects preferred
- Product Management experience utilizing GenAI
- Undergraduate degree or equivalent combination of training and experience required
- Graduate degree preferred
Benefits
- Health insurance
- Retirement plans
- Paid time off
- Flexible working arrangements
- Professional development
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
product managementGenerative AIdata sciencemodel performance trackingquality assessmentacceptance criteria definitionannotation strategiescontinuous model monitoringuser feedback analysisexperimentation
Soft Skills
leadershipcollaborationcommunicationprioritizationstrategic thinkingproblem-solvingadaptabilitystakeholder managementdecision-makingcreativity
Certifications
undergraduate degreegraduate degree