Heidi Health

Medical AI Specialist

Heidi Health

full-time

Posted on:

Location Type: Hybrid

Location: Melbourne • Australia

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

CloudJavaScriptPythonSQL

About the role

  • Help shape our AI products by infusing medical insights with deep technical knowledge
  • Collaborate across teams to turn clinician needs into reliable, high-impact AI features
  • Own the clinical integrity of Heidi: advise clinicians, troubleshoot edge cases, and validate outputs
  • Partner with product, engineering and design teams to engineer prompts, build agentic AI, create model evaluation frameworks, and fine-tune models.
  • Build cutting-edge AI features within Heidi using the latest tools and frameworks
  • Plan and collaborate on research studies that prove our AI scribe’s clinical accuracy and user impact
  • Advise leadership on clinical quality and product roadmap priorities
  • Mentor colleagues and help build a culture of clinical excellence and collaboration

Requirements

  • Clinician with AI product experience
  • Previous hands-on experience building scalable AI products or features for healthcare settings
  • LLM & foundation-model expertise
  • Deep experience with large language models and provider APIs (OpenAI, Claude, Gemini), building LLM-powered healthcare products and features
  • Prompt engineering & safety
  • Proven track record crafting, iterating, and testing prompts; mitigating bias and hallucinations; embedding clinical safety guardrails
  • Cross-functional collaboration
  • Translate clinical needs into technical specs, partner closely with engineering and product teams, and embed quality controls for clinician trust
  • Performance optimization
  • Optimise AI features for accuracy, latency, scalability, and cost (“fast, safe, cheap”)
  • RAG pipelines & evaluation
  • Build and maintain retrieval-augmented generation pipelines and automated evaluation workflows (traditional ML metrics, LLM-as-judge, A/B tests, clinician feedback loops)
  • AI agent design & fine-tuning
  • Design, build, and orchestrate multi-step AI agents; fine-tune or adapt models on medical datasets
  • Semantic search & vector DBs
  • Hands-on experience with embeddings, vector databases, and agent frameworks like LangChain
  • Software engineering & ML fundamentals: **Fundamental understanding of Python, JavaScript, SQL; experience with cloud platforms and ML frameworks
Benefits
  • Flexible hybrid working environment, with 3 days in the office.
  • Additional paid day off for your birthday
  • Special corporate rates at Anytime Fitness in Melbourne, Sydney tbc.
  • A generous personal development budget of $500 per annum
  • Learn from some of the best engineers and creatives, joining a diverse team
  • Become an owner, with shares (equity) in the company, if Heidi wins, we all win
  • The rare chance to create a global impact as you immerse yourself in one of Australia’s leading healthtech startups
  • If you have an impact quickly, the opportunity to fast track your startup career!
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
large language modelsprompt engineeringperformance optimizationretrieval-augmented generation pipelinesautomated evaluation workflowsAI agent designfine-tuning modelssemantic searchvector databasessoftware engineering
Soft Skills
cross-functional collaborationmentoringadvising leadershiptranslating clinical needsbuilding culture of clinical excellence