AI Backend Engineer

Parallel Partners

AI Backend Engineer building systems for AI-driven decision-making and automation. Fully remote position supporting a global engineering team.

Posted 7/3/2026full-timeRemote • California • 🇺🇸 United StatesMid-LevelSenior💰 $140,000 - $200,000 per yearWebsite

Tech Stack

Tools & technologies

Distributed Systems

About the role

Key responsibilities & impact

Build and operate backend systems that serve AI-powered insurance workflows in production.
Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.
Build inference pipelines for LLM-based and AI-assisted automation systems.
Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing).
Design stable service boundaries between backend systems, ML components, and product APIs.
Implement observability: logging, metrics, tracing, alerting, and incident response workflows.
Debug production issues across distributed AI systems and resolve root causes.
Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features.
Continuously improve system reliability, scalability, and performance.

Requirements

What you’ll need

Strong backend engineering experience in production systems.
Experience building or operating high-throughput, low-latency services.
Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows).
Experience with distributed systems and production debugging.
Strong understanding of APIs, data flows, and system design principles.
Experience with observability tools (logging, monitoring, tracing).
Strong ownership mindset and bias toward shipping.
Comfortable working in fast-paced, globally distributed teams.

Benefits

Comp & perks

medical insurance
Dental
Vision
Savings Plan Options
PTO

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Backend Systems DevelopmentAI Orchestration DesignInference Pipeline ConstructionLatency OptimizationAPI DesignSystem Design PrinciplesProduction DebuggingService Boundary DesignPerformance Improvement

Soft Skills

Strong Ownership MindsetCollaboration