Staff Machine Learning Engineer

SuperDial

Machine Learning Engineer fine-tuning open-source LLMs for healthcare workflows at SuperDial. Collaborating across teams to improve AI systems for revenue cycle management.

Posted 5/8/2026full-timeBurlingame • California • 🇺🇸 United StatesLead💰 $225,000 - $325,000 per yearWebsite

Tech Stack

Tools & technologies

PythonPyTorch

About the role

Key responsibilities & impact

Build, maintain, and improve supervised fine-tuning pipelines for open-source LLMs.
Fine-tune models for healthcare administrative workflows involving multi-turn conversations, tool use, structured outputs, and task execution.
Develop and refine training datasets from expert examples, workflow traces, synthetic data, user interactions, and model failure cases.
Create evaluation frameworks to measure task completion, instruction following, factual grounding, tool-use accuracy, and regression quality.
Analyze model failures and translate findings into improvements across data, training, prompting, retrieval, tooling, and product behavior.
Collaborate with healthcare and RCM experts to learn workflows and convert domain knowledge into model behavior.
Support production deployment, monitoring, and continuous model improvement.

Requirements

What you’ll need

Hands-on experience fine-tuning open-source LLMs using supervised fine-tuning (SFT) pipelines.
Strong Python and PyTorch skills.
Experience with LLM tooling such as Hugging Face Transformers, PEFT, TRL, Axolotl, DeepSpeed, FSDP, vLLM, or similar frameworks.
Experience preparing, cleaning, labeling, and validating instruction-tuning datasets.
Familiarity with agentic LLM systems, including tool calling, structured generation, retrieval, or workflow execution.
Experience evaluating LLMs using offline benchmarks, human review, regression testing, or production feedback.
Strong debugging skills and the ability to systematically improve model behavior.

Benefits

Comp & perks

Competitive compensation with equity upside

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

fine-tuningsupervised fine-tuningPythonPyTorchHugging Face TransformersPEFTTRLAxolotlDeepSpeedFSDP

Soft Skills

debuggingcollaborationsystematic improvement