Head of Engineering, Decision Support
Sully.ai
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $230,000 - $280,000 per year
Job Level
Lead
About the role
- Lead the productization of ML/LLM-powered decision support systems with strict quality, safety, and latency benchmarks.
- Build and scale engineering teams with a strong observability and reliability culture.
- Design and launch inference pipelines with fallbacks, caching, A/B evaluation, and rollback capabilities.
- Collaborate with clinicians, compliance experts, and cross-functional leaders to ensure interpretability, auditability, and clinical trust in deployed systems.
- Drive innovation in agentic workflows (recommendations, triage, treatment support) that balance automation with safety.
- Audit existing decision support infrastructure and identify reliability/latency bottlenecks (first-month focus).
- Establish engineering standards for observability, fallbacks, and A/B evaluation pipelines (first-month focus).
- Partner with the EHR Integrations team on upcoming FHIR-driven workflows (Q4 2025).
- Launch and monitor production inference pipelines with measurable improvements in latency and throughput (90-day OKR).
- Deliver a decision support use case with clinical interpretability and audit features enabled and hire core engineering talent (90-day OKRs).
Requirements
- Proven leadership in shipping ML/LLM systems with measurable quality, latency, and reliability outcomes.
- Deep experience in decision support contexts, including agentic or recommendation systems.
- Expertise building production-grade inference pipelines with safety, caching, and evaluation frameworks.
- Exceptional communicator able to align technical and clinical stakeholders.
- Team builder with a track record of establishing observability-first engineering practices.
- Familiarity with healthcare data standards (FHIR, HL7) and clinical reasoning patterns (nice-to-have).
- Experience working with EHR integrations and compliance-sensitive systems (nice-to-have).
- Background in explainable AI, interpretability, or audit trails for clinician-facing tools (nice-to-have).
- Willingness/ability to work up to 80 hours/week (application question).
- Must not require visa sponsorship (posting notes they are unable to sponsor new visas).
Benefits
- Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
- Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
- Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
- Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
- Offers Equity
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ML systemsLLM systemsinference pipelinescaching frameworksA/B evaluationdecision support systemsagentic workflowsreliability outcomesquality benchmarkslatency benchmarks
Soft skills
leadershipcommunicationteam buildingcollaborationinnovationalignmentestablishing practicesexceptional communicatorclinical trustauditability