Heidi Health

Product Manager, Models

Heidi Health

full-time

Posted on:

Location Type: Hybrid

Location: San Francisco • United States

Visit company website

Explore more

✨ AI Apply
Apply

About the role

  • Own product strategy and roadmap for Heidi's models platform (evaluation, safety, model routing, fine-tuning infrastructure), setting clear goals and being held accountable to achieving them
  • Prioritise your team's work across enablement requests, model safety and quality, and bets on new capabilities
  • Figure out where product teams get stuck on your models and fix the platform so they don't
  • Build eval tooling and fine-tuning workflows that your engineers and product teams can actually use in clinical settings
  • Decide what to improve next by reading clinician feedback, model quality signals, and what product teams are asking for
  • Allocate engineering capacity across product teams who all want more than you can give, and tell them clearly what you're deferring
  • Work with your engineers on eval design, fine-tuning trade-offs, and model architecture decisions at a technical level
  • Set model quality and safety targets grounded in clinical outcomes (did the note capture the right diagnosis? did the referral letter contain the right history?)
  • Spot infrastructure that two product teams are building separately and consolidate it
  • Watch foundation model developments and decide when to rip up your roadmap

Requirements

  • 4+ years working on AI platform, infrastructure, or model-adjacent products, though we care more about what you've built than time served
  • Technical depth on model evaluation, fine-tuning, and production AI systems. You've designed eval suites, debugged model regressions, and understand what makes models fail in production.
  • Genuine curiosity about what models get wrong in clinical settings and why
  • Technical enough to hold your own with your engineers, credible enough to present safety trade-offs to leadership
  • You use AI tools to do your own work, not just manage people who do
  • Strong opinions, weakly held. You'll shift the room when you're right.
  • Willingness to update your views when the technology shifts, which it does roughly quarterly.
  • Data fluency with diagnostic teeth - can you read evaluation results and distinguish a real regression from noise? Can you design an eval that catches the thing your current suite misses?
Benefits
  • Flexible hybrid working environment, with 3 days in the office.
  • A generous personal development budget of $500 per annum
  • Learn from some of the best engineers and creatives, joining a diverse team
  • Become an owner, with shares (equity) in the company, if Heidi wins, we all win
  • The rare chance to create a global impact as you immerse yourself in one of Australia’s leading healthtech startups
  • If you have an impact quickly, the opportunity to fast track your startup career!
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
model evaluationfine-tuningproduction AI systemseval designdebugging model regressionsclinical outcomes analysismodel architecture decisionsdata fluencydiagnostic evaluation
Soft Skills
product strategyaccountabilityprioritizationcommunicationcollaborationcuriosityadaptabilityopinion leadershipproblem-solving