Senior Backend AI Engineer

Arbiter

full-time

Posted on:

Location Type: Remote

Location: New YorkUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $180,000 - $240,000 per year

Job Level

About the role

  • Design, build, and operate the backend AI systems that power Arbiter’s intelligent care orchestration platform.
  • Own critical parts of our agentic infrastructure, from low-latency inference pipelines to workflow automation and service orchestration.
  • Ship and maintain production-grade AI systems that automate complex clinical and administrative workflows.
  • Contribute to the architectural design of Arbiter’s AI-driven platform, emphasizing modularity and scalability.
  • Ensure high performance, low latency, and fault tolerance across backend services and AI inference pipelines.
  • Implement and uphold best practices for CI/CD, testing, observability, and deployment of backend and AI systems.
  • Partner closely with data scientists, product managers, clinical experts, and other engineers.
  • Mentor engineers, contribute to internal documentation and standards, and raise the overall engineering bar.
  • Take end-to-end ownership of critical systems, including participating in on-call rotations.

Requirements

  • 5 + years of hands-on experience building and operating production backend systems, recent experience with AI-powered services and automation workflows, in high-availability environments.
  • Computer Science or Engineering degree, or equivalent practical experience.
  • Experience building and maintaining large-scale Python codebases with strong opinions on structure, quality, and tradeoffs.
  • Proven experience designing and operating complex backend systems in production.
  • Deep understanding of concurrency, scalability, reliability, and distributed systems patterns.
  • Hands-on experience with async or event-driven architectures.
  • Experience designing and operating high-scale APIs (REST and/or gRPC), including versioning and backward compatibility.
  • Experience with cloud infrastructure (AWS, GCP, or Azure) and production deployments.
  • Experience building and shipping AI-powered systems beyond prototypes or internal demos.
  • Strong communication skills and ability to work effectively across functions.
Benefits
  • Highly Competitive Salary & Equity Package: Designed to rival top FAANG compensation, including meaningful equity.
  • Generous Paid Time Off (PTO): To ensure a healthy work-life balance.
  • Comprehensive Health, Vision, and Dental Insurance: Robust coverage for you and your family.
  • Life and Disability Insurance: Providing financial security.
  • Simple IRA Matching: To support your long-term financial goals.
  • Professional Development Budget: Support for conferences, courses, and certifications to fuel your continuous learning.
  • Wellness Programs: Initiatives to support your physical and mental health.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonAI systemsbackend systemsCI/CDtestingobservabilityevent-driven architectureREST APIsgRPCcloud infrastructure
Soft skills
communicationmentoringcollaborationproblem-solvingleadership
Certifications
Computer Science degreeEngineering degree