mpathic

Senior Technical Program Manager – TPM

mpathic

full-time

Posted on:

Location Type: Remote

Location: Washington • United States

Visit company website

Explore more

✨ AI Apply
Apply

Salary

💰 $140,000 - $200,000 per year

Job Level

Senior

About the role

  • Own Clinically Grounded AI Evaluation Delivery (Core)
  • Lead evaluation projects from kickoff → rubric → execution → QA → final reporting
  • Define milestones, timelines, and delivery SLAs
  • Manage delivery risk in sensitive, high-stakes domains
  • Ensure outputs are rigorous, clinically appropriate, and customer-ready
  • Evaluate safety, appropriateness, and response quality—not clinical outcomes
  • Familiarity with scope, limits, and responsible handling of sensitive content
  • Design Rubrics & Annotation Protocols
  • Partner with mpathic behavioral experts to define rating criteria
  • Build labeling guides for psychological state, intent, appropriateness, and harm risk
  • Ensure rubrics balance clinical nuance with operational usability
  • Drive Quality & Calibration Systems
  • Implement review tiers: peer review → QA → escalation
  • Run inter-rater reliability and disagreement reduction workflows
  • Maintain gold sets and drift monitoring over time
  • Tooling & Workflow Ownership
  • Translate evaluation needs into requirements for internal tooling: Work queues and labeling interfaces
  • Audit trails and version control
  • Taxonomies for stress, crisis, and safety response categories
  • Reporting automation and reproducibility pipelines
  • Metrics & Operational Excellence
  • Own evaluation program dashboards including: Throughput per expert per day, Agreement and defect rates, Cycle time and on-time delivery, Safety actionability metrics (e.g., customer acceptance, mitigation impact)
  • Customer & Stakeholder Execution Support
  • Help scope clinically sensitive evaluation engagements
  • Translate customer priorities into clear execution plans
  • Present findings with clinical and operational clarity

Requirements

  • 5+ years of experience in one or more of: Technical project/program management and team leadership experience
  • Clinical research experience and/or report writing
  • Organize and analyze qualitative data, in addition to synthesizing key findings
  • Train and coach clinicians to engage in high-level data analysis with the end goal of developing safety rubrics and evaluation systems
  • Navigate evolving rubrics, edge cases, and judgment calls
  • AI evaluation or annotation programs
  • Trust & safety, human-centered AI, or behavioral science workflows
  • Licensed clinician (LCSW, LMFT, PsyD, PhD, MD) or equivalent applied experience
  • Expertise in qualitative data, annotation and/or evaluating clinical conversations for safety and mental health content
  • Deep familiarity with psychological stress, trauma, crisis response, or mental health frameworks
  • Ability to evaluate model behavior in emotionally complex, high-stakes conversations.
Benefits
  • 100% company-funded health, dental, and vision insurance for full-time employees.
  • 401k
  • well-being programs
  • flexible paid-time off
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
AI evaluationannotation programsqualitative data analysisrubric designevaluation systemsreport writingdata synthesisinter-rater reliabilitymetrics analysisreporting automation
Soft Skills
project managementteam leadershipcommunicationcoachingrisk managementcustomer engagementclarity in presentationadaptabilitycritical thinkingcollaboration
Certifications
LCSWLMFTPsyDPhDMD