Senior AI Safety Clinical Reviewer – TPM
mpathic
full-time
Posted on:
Location Type: Remote
Location: Washington • United States
Visit company websiteExplore more
Salary
💰 $140,000 - $190,000 per year
Job Level
About the role
- Establish and evolve a reliable clinical QA and adjudication workflow across evaluation projects, identifying gaps and improving on systems
- Train and onboard expert raters on safety rubrics, shared standards, and evaluation philosophy
- Run calibration sessions to reduce disagreement and improve consistency
- Serve as the escalation point for ambiguous or high-risk conversations
- Deliver adjudicated, high-confidence evaluation datasets for an initial pilot
- Demonstrate calibrated clinical judgment aligned with mpathic’s safety philosophy
- Design workflows that others can run without constant oversight
- Own clinical quality systems across multiple concurrent AI safety evaluation programs
- Develop scalable training, certification, and feedback loops for expert evaluators
- Continuously improve inter-rater reliability, rubric clarity, and reviewer consistency
- Build gold-standard examples and clinical playbooks for sensitive user contexts
- Identify recurring model failure patterns and inform rubric/tooling improvements
Requirements
- 5+ years of experience in one or more of: Clinical supervision, training, or peer review
- Clinical research operations or qualitative review
- Trust & safety, human-centered AI, or behavioral science workflows
- AI evaluation, annotation QA, or rubric-based assessment systems
- Coaching clinicians or experts to apply shared standards in high-stakes domains
- Licensed clinician (LCSW, LMFT, PsyD, PhD, MD) or equivalent applied experience
- Deep familiarity with psychological stress, trauma, crisis response, or mental health frameworks
- Expertise evaluating emotionally complex conversations for safety, appropriateness, and harm risk
Benefits
- 100% company-funded health, dental, and vision insurance for full-time employees.
- 401k
- Well-being programs
- Flexible paid-time off
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
clinical QAadjudication workflowevaluation projectscalibration sessionsinter-rater reliabilityrubric claritytrainingannotation QArubric-based assessment systemsevaluation datasets
Soft Skills
clinical judgmentcoachingcommunicationproblem-solvingleadershiptraining and onboardingconsistencyfeedback loopsadaptabilitycollaboration
Certifications
LCSWLMFTPsyDPhDMD