AI Research Engineer

Hello Patient

Research Engineer in AI, advancing a voice agent for healthcare. Collaborating on experimental designs and prompt engineering to enhance AI performance.

Posted 6/3/2026full-timeNew York City • New York • 🇺🇸 United StatesMid-LevelSenior💰 $180,000 - $230,000 per yearWebsite

About the role

Key responsibilities & impact

Design structured experiments with real controls and statistical rigor
Build regression test coverage to know when a global prompt change is breaking things across workflows
Create a pipeline of validated, high-confidence improvements for engineering
Work with the team to prioritize what gets shipped based on experiment results
Own prompt design across Mia's agent workflows
Stay current on prompting research, bring back ideas worth testing
Prototype new approaches locally
Collaborate with Product and Engineering teams
Translate experiment results into clear recommendations
Build out evaluation templates and frameworks

Requirements

What you’ll need

5+ years of experience in a prompting, AI research, or applied AI role
Advanced degree in a research-oriented field (PhD preferred) - CS, linguistics, cognitive science, stats, or similar
Real prompt engineering experience - deliberately designing, testing, and improving prompts to change system behavior
Solid experimental design fundamentals: controls, statistical significance, knowing when a result actually means something
Hands-on experience working with LLMs in applied contexts
Comfort with RAG, agentic architectures, and modern LLM tooling
Ability to evaluate and validate AI system behavior - understanding what the model is doing and why
Clear written communication; your findings need to land with engineers and non-technical stakeholders alike.

Benefits

Comp & perks

Meaningful ownership in a fast-growing healthtech startup

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

prompt engineeringexperimental designstatistical significanceregression testingpipeline developmentevaluation frameworksLLMs (Large Language Models)RAG (Retrieval-Augmented Generation)agentic architecturesapplied AI

Soft Skills

collaborationclear written communicationprioritizationtranslating resultscritical thinking

Certifications

PhD in Computer SciencePhD in LinguisticsPhD in Cognitive SciencePhD in Statistics