Software Engineer – Realtime Systems

Baseten

Lead Voice AI product areas as a Software Engineer at Baseten. Design and implement high-performance model serving systems for real-time AI applications.

Posted 4/27/2026full-timeSan Francisco • California • 🇺🇸 United StatesMid-LevelSenior💰 $165,000 - $330,000 per yearWebsite

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Own and lead Voice AI product areas end-to-end — from architecture and system design through implementation, rollout, and long-term production operations.
Design, build, and operate real-time, large-scale, high-performance model serving systems for STT, TTS, and voice agent workloads with clear SLOs for mission-critical customer deployments.
Drive cross-team collaboration with sister engineering teams to solve full-stack technical problems, aligning on priorities, and coordinating end-to-end delivery across the product surface area.
Mentor teammates through code reviews, design docs, and technical leadership.

Requirements

What you’ll need

Bachelor's degree or higher in Computer Science or related field
Proven track record owning production-grade real-time, large-scale systems where tail latency (p99) matters.
Proficient coding abilities in one or more popular programming or scripting languages; Python proficiency is a plus.
Good taste in product, particularly developer-oriented tools
Interest in ML/AI infrastructure and willingness to learn
Strong collaboration and communication skills
Comfortable using AI coding assistants (e.g., Claude Code, Codex, Cursor) as a daily productivity multiplier — as an AI-native company, we see this as a must-have skill.

Benefits

Comp & perks

Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

system designreal-time systemslarge-scale systemsmodel servingSTTTTSPythonproduction-grade systemstail latencyML/AI infrastructure

Soft Skills

technical leadershipcollaborationcommunicationmentoringproblem-solvingprioritization

Certifications

Bachelor's degree in Computer Science