Staff Software Engineer, AI Engineer

Midi Health

Set the direction for AI systems in a modern healthcare company. Leading software architecture and technical strategy with strong emphasis on AI and LLMs.

Posted 4/25/2026full-timePalo Alto • California • 🇺🇸 United StatesLead💰 $210,000 - $260,000 per yearWebsite

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Lead technical strategy for AI/LLM systems across Midi's product surfaces
Architect retrieval, orchestration, agentic, and evaluation systems that run reliably in production
Set the standards for AI safety, evaluation, observability, and responsible rollout in a healthcare context
Partner with clinical, product, and executive leadership to shape the AI roadmap
Mentor senior and mid-level engineers into strong AI engineers; raise the AI literacy of the whole org
Lead the frontier: evaluate new models, techniques, and tools, and bring the right ones into the team

Requirements

What you’ll need

10+ years of software engineering experience, with deep recent time leading production AI/LLM systems
Seasoned hands-on coder; still writes production Python regularly
Seasoned system designer for AI systems at scale — retrieval, agents, evaluation, latency, and cost
Authority in AI engineering: teams and leaders defer to your judgment, and you can defend it rigorously
Leader at the AI frontier: you set how the team uses AI tooling and how we build AI products
Seasoned mentor; you've grown engineers into strong AI builders
Strong communicator with product, clinical, and executive stakeholders; thoughtful about risk and safety tradeoffs
Low-ego, curious, humble

Benefits

Comp & perks

wide range of benefits and equity in the company

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI systemsLLM systemsPythonsystem designretrieval systemsorchestration systemsevaluation systemsproduction systemsAI toolingAI product development

Soft Skills

leadershipmentoringcommunicationcollaborationrisk assessmentcuriosityhumilityjudgmentevaluationAI literacy