Applied AI Engineer

Ascertain

AI Engineer building voice agents to automate healthcare workflows. Join Ascertain to transform healthcare with AI solutions that directly impact care teams and operational efficiency.

Posted 5/1/2026full-timeNew York City • New York • 🇺🇸 United StatesMid-LevelSenior💰 $130,000 - $175,000 per yearWebsite

Tech Stack

Tools & technologies

NoSQLPythonSQL

About the role

Key responsibilities & impact

Design, build, and ship voice agents that conduct outbound calls to payers - handling IVR navigation, hold queues, multi-turn dialogue with human reps, and structured data capture.
Integrate telephony, speech-to-text, text-to-speech, and LLM components into reliable end-to-end pipelines, and own them in production.
Build the evaluation and QA infrastructure that lets us measure agent quality, catch regressions, and continuously improve performance against real-world calls.
Develop and maintain the APIs and integrations that connect agent outputs to the rest of our prior authorization workflow.
Instrument everything: call outcomes, agent behavior, latency, failure modes - and use that data to make the next version better.
Partner closely with our operations and clinical teams to identify the highest-leverage workflows to automate next, and translate those into agent designs.
As the AI surface area at Ascertain grows, expand into other agent and LLM-driven systems across the product and internal tooling.

Requirements

What you’ll need

4+ years of professional software engineering experience owning production systems end-to-end—from design through deployment, monitoring, and iteration.
2+ years of professional Python experience building APIs, services, or data workflows.
Hands-on experience developing or deploying LLM-based applications or RAG systems in a real production setting (not just prototypes).
Comfort operating with ambiguity and shipping the first version of something that doesn't exist yet.
Strongly preferred hands-on experience with voice or conversational systems - IVR, call automation, speech-to-text, telephony APIs (Twilio, etc.), or conversational agents.
Experience implementing QA processes and evaluation frameworks for agentic or LLM-based systems.
Track record of building and maintaining RESTful APIs and third-party integrations.
Proficiency with observability and monitoring tools for production reliability.
Experience with version control and automated CI/CD deployment pipelines.
Comfort managing SQL or NoSQL databases for storing and analyzing interaction data.
Healthcare, payer, or revenue cycle domain experience (helpful but absolutely not required).

Benefits

Comp & perks

Meaningful work: Your work will directly impact healthcare organizations by reducing administrative burden and improving how care teams operate day to day.
Ownership and growth: You’ll join Ascertain at an early stage, with meaningful equity and the opportunity to shape our product, technical direction, and how this function evolves over time.
Competitive compensation: We offer a competitive salary, meaningful equity, comprehensive health benefits, and other standard benefits appropriate for a growing company.
Flexible work model: This role is remote-friendly. For NYC-based team members, we support a hybrid model with regular in-office collaboration. We trust people to manage their time and work like adults.
Collaborative team: You’ll work alongside a thoughtful, mission-driven team with backgrounds spanning healthcare operations, product, and engineering.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonAPIsLLM-based applicationsRAG systemsIVRcall automationspeech-to-texttelephony APIsRESTful APIsSQL

Soft Skills

operating with ambiguityproblem-solvingcollaborationcommunicationiteration