AI Product Manager
Navigate AI
full-time
Posted on:
Location Type: Remote
Location: California • New York • United States
Visit company websiteExplore more
About the role
- Own model evaluation and quality standards
- Take full ownership of all evaluation systems, validation sets and quality metrics
- Establish and maintain “golden sets” for every product as the source of truth for quality and accuracy
- Drive measurable accuracy improvements
- Lead accuracy initiatives across all products, improving precision, recall, and overall model performance
- Define and track AI performance metrics and client SLAs as we scale
- Automate quality workflows
- Identify manual QA and data entry processes and redesign them through automation
- Reduce human intervention by increasing model confidence, reliability, and repeatability
- Build scalable evaluation pipelines
- Create repeatable processes to evaluate pilots and active customers quickly
- Ensure accuracy metrics remain high as customer volume and product surface area grow
- Close the real-world feedback loop
- Capture and analyze real-world model errors
- Prioritize accuracy issues and partner with Engineering to drive continuous model improvement
Requirements
- Strong analytical foundation
- Hypothesis-driven problem solver with deep comfort in data analysis and metrics
- Understands statistical significance and how to curate representative validation datasets
- Bias toward execution and ownership
- Thrives in ambiguity and moves quickly from problem to solution
- Comfortable owning outcomes end-to-end and delivering results without perfect information
- Technical fluency (without needing to code)
- Understands data pipelines, model behavior, and ML workflows
- Can scope issues clearly and collaborate effectively with engineers
- Proficient in SQL
- Early adopter of vibe-coding tools
- AI-native mindset
- Learns and adopts new AI tools quickly
- Continuously improves workflows to maximize automation and leverage model capabilities
- Clear communicator and influencer
- Translates complex accuracy metrics into clear, actionable insights
- Aligns Product, Engineering, and Go-To-Market teams around quality standards and priorities
Benefits
- Help define the future of AI Copilots in a huge market ripe for transformation
- Massive ownership and impact as an early team member
- Work with high-agency teammates and major enterprise customers
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data analysisSQLmodel evaluationquality metricsAI performance metricsautomationdata pipelinesML workflowsaccuracy metricsvalidation datasets
Soft skills
analytical thinkingproblem solvingownershipadaptabilitycommunicationcollaborationinfluenceexecutioncuriositycontinuous improvement