Senior Backend AI Engineer
Arbiter
full-time
Posted on:
Location Type: Remote
Location: New York • United States
Visit company websiteExplore more
Salary
💰 $180,000 - $240,000 per year
Job Level
About the role
- Design, build, and operate the backend AI systems that power Arbiter’s intelligent care orchestration platform.
- Own critical parts of our agentic infrastructure, from low-latency inference pipelines to workflow automation and service orchestration.
- Ship and maintain production-grade AI systems that automate complex clinical and administrative workflows.
- Contribute to the architectural design of Arbiter’s AI-driven platform, emphasizing modularity and scalability.
- Ensure high performance, low latency, and fault tolerance across backend services and AI inference pipelines.
- Implement and uphold best practices for CI/CD, testing, observability, and deployment of backend and AI systems.
- Partner closely with data scientists, product managers, clinical experts, and other engineers.
- Mentor engineers, contribute to internal documentation and standards, and raise the overall engineering bar.
- Take end-to-end ownership of critical systems, including participating in on-call rotations.
Requirements
- 5 + years of hands-on experience building and operating production backend systems, recent experience with AI-powered services and automation workflows, in high-availability environments.
- Computer Science or Engineering degree, or equivalent practical experience.
- Experience building and maintaining large-scale Python codebases with strong opinions on structure, quality, and tradeoffs.
- Proven experience designing and operating complex backend systems in production.
- Deep understanding of concurrency, scalability, reliability, and distributed systems patterns.
- Hands-on experience with async or event-driven architectures.
- Experience designing and operating high-scale APIs (REST and/or gRPC), including versioning and backward compatibility.
- Experience with cloud infrastructure (AWS, GCP, or Azure) and production deployments.
- Experience building and shipping AI-powered systems beyond prototypes or internal demos.
- Strong communication skills and ability to work effectively across functions.
Benefits
- Highly Competitive Salary & Equity Package: Designed to rival top FAANG compensation, including meaningful equity.
- Generous Paid Time Off (PTO): To ensure a healthy work-life balance.
- Comprehensive Health, Vision, and Dental Insurance: Robust coverage for you and your family.
- Life and Disability Insurance: Providing financial security.
- Simple IRA Matching: To support your long-term financial goals.
- Professional Development Budget: Support for conferences, courses, and certifications to fuel your continuous learning.
- Wellness Programs: Initiatives to support your physical and mental health.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonAI systemsbackend systemsCI/CDtestingobservabilityevent-driven architectureREST APIsgRPCcloud infrastructure
Soft skills
communicationmentoringcollaborationproblem-solvingleadership
Certifications
Computer Science degreeEngineering degree