Product Manager – Eval
Jusbrasil
full-time
Posted on:
Location Type: Remote
Location: Brazil
Visit company websiteExplore more
About the role
- Lead the AI model quality and evaluation strategy
- Define what constitutes quality in AI outputs and how to measure it
- Establish when and how to use automated evaluation and human validation
- Build and prioritize the Evals roadmap, aligned with the area's strategy
- Translate complex technical problems into clear product decisions
- Connect technical decisions to real business impact
- Create scalable, reusable frameworks for model evaluation
- Enable other teams to use AI with quality
Requirements
- Experience as a Product Manager for technical products (data or AI-adjacent)
- Strong ability to collaborate with engineering and technical teams
- Hands-on experience with data (data quality, structuring, and analysis)
- Experience with prioritization and backlog management in complex contexts
- Familiarity with AI, LLMs, or GenAI
- Excellent stakeholder management and communication skills
- Ability to turn ambiguous problems into structured solutions
Benefits
- We value those who pursue deep expertise
- Agility with clarity of purpose
- Opportunity for individuals who want to tackle challenges with consistency and excellence
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI model evaluationdata qualitydata structuringdata analysisautomated evaluationhuman validationframework developmentprioritizationbacklog management
Soft Skills
collaborationstakeholder managementcommunicationproblem-solvingstrategic thinking