
Senior AI Software Engineer
Future
full-time
Posted on:
Location Type: Remote
Location: United States
Visit company websiteExplore more
Salary
💰 $215,000 - $250,000 per year
Job Level
About the role
- Build and ship AI agents that serve real users: tool-calling LLM systems with structured output, parallel API orchestration, and streaming responses.
- Design evaluation harnesses and quality scoring — we use Langfuse, rubrics to measure safety, effectiveness, and personalization.
- Own the full loop: prototype a new agent capability, validate it with evals, deploy it to staging and production, monitor traces, and iterate.
- Improve reliability, latency, and cost through prompt caching strategies, token budgets, retry logic, and observability.
- Write the tools agents use: API integrations with Pydantic validation, exercise search over local databases, structured workout submission.
Requirements
- Strong Python skills: you've built and deployed services on large production systems.
- Experience with LangChain/LangGraph or similar agent frameworks.
- Hands-on experience with LLMs in production: prompt engineering, tool/function calling, structured output, evaluation.
- Comfort with async Python, HTTP APIs, and streaming protocols (SSE, webhooks).
- Experience with data validation and schema design (Pydantic, JSON Schema).
- Ability to debug across layers: from a broken LLM tool call to a misconfigured Terraform resource.
- Clear communication: you'll work directly with product, mobile, and backend engineers.
Benefits
- Comprehensive medical, vision, dental, and disability insurance plus tax savings accounts for all eligible employees.
- 401(k) plan with tax-advantaged savings options.
- Monthly health and fitness stipend contributing to overall wellbeing, access to a mental health platform, reimbursement for medical travel, and an annual learning & development stipend.
- Flexible PTO so you can rest, recharge, and take care of life outside of work.
- Enjoy our platform for free!
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonLLMsprompt engineeringtool/function callingdata validationschema designasync PythonHTTP APIsstreaming protocolsdebugging
Soft Skills
clear communication