AI Research Engineer – Prompting

Hello Patient

Prompting & AI Agent Research Engineer developing experimental designs for AI advancements at Hello Patient. Leading research and experimentation to enhance AI voice agent performance in healthcare.

Posted 6/3/2026full-timeRemote • 🇺🇸 United StatesMid-LevelSenior💰 $180,000 - $230,000 per yearWebsite

About the role

Key responsibilities & impact

Design structured experiments with real controls and statistical rigor
Build regression test coverage so we know when a global prompt change is breaking things across workflows we didn't expect
Create a pipeline of validated, high-confidence improvements engineering can pull from instead of building on faith
Work with the team to prioritize what actually gets shipped based on what the experiments say
Own prompt design across Mia's agent workflows - multi-turn, voice-first, healthcare context
Stay current on what's coming out in prompting research, and agent architecture, and bring back ideas worth testing
Prototype new approaches locally before anything touches production
Be the person the Product team comes to when they're stuck on a prompting problem
Work closely with our Product and Engineering teams - understand where Mia is struggling and help decide what's worth experimenting on
Translate experiment results into clear recommendations people can actually act on
Build out evaluation templates and frameworks so this doesn't live only in your head

Requirements

What you’ll need

5+ years of experience in a prompting, AI research, or applied AI role
Advanced degree in a research-oriented field (PhD preferred) - CS, linguistics, cognitive science, stats, or similar
Real prompt engineering experience - deliberately designing, testing, and improving prompts to change system behavior
Solid experimental design fundamentals: controls, statistical significance, knowing when a result actually means something
Hands-on experience working with LLMs in applied contexts
Comfort with RAG, agentic architectures, and modern LLM tooling
Ability to evaluate and validate AI system behavior - understanding what the model is doing and why
Clear written communication; your findings need to land with engineers and non-technical stakeholders alike.

Benefits

Comp & perks

Equity: Meaningful ownership in a fast-growing healthtech startup

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

prompt engineeringexperimental designstatistical significanceregression testingLLMsRAGagentic architecturesdata analysisprototypingevaluation frameworks

Soft Skills

clear written communicationcollaborationproblem-solvingprioritizationcritical thinkingadaptabilitycreativitydecision-makingtranslating findingsstakeholder engagement

Certifications

PhD in Computer SciencePhD in LinguisticsPhD in Cognitive SciencePhD in Statistics