AI Backend Engineer

Parallel Partners

AI Backend Engineer building systems for AI-driven decision-making and automation. Fully remote position supporting a global engineering team.

Posted 7/3/2026full-timeRemote • California • 🇺🇸 United StatesMid-LevelSenior💰 $140,000 - $200,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in backend engineering for AI-powered systems, focusing on building high-throughput, low-latency services while ensuring system reliability and observability. Collaborates effectively with cross-functional teams to deliver end-to-end features in a fast-paced environment.

Highest-signal resume keywords

Backend Engineering ExperienceHigh-Throughput ServicesAI Systems FamiliarityObservability Tools ExperienceDistributed Systems Debugging

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Backend Systems DevelopmentAI Orchestration DesignInference Pipeline ConstructionLatency OptimizationAPI DesignSystem Design PrinciplesProduction DebuggingService Boundary DesignPerformance Improvement

Soft Skills

Strong Ownership MindsetCollaboration

Tools & Technologies

Logging ToolsMonitoring ToolsTracing ToolsIncident Response Workflows

Industry Keywords

AI WorkflowsDistributed SystemsProduction SystemsMachine Learning Components

Tech Stack

Tools & technologies

Distributed Systems

About the role

Key responsibilities & impact

Build and operate backend systems that serve AI-powered insurance workflows in production.
Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.
Build inference pipelines for LLM-based and AI-assisted automation systems.
Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing).
Design stable service boundaries between backend systems, ML components, and product APIs.
Implement observability: logging, metrics, tracing, alerting, and incident response workflows.
Debug production issues across distributed AI systems and resolve root causes.
Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features.
Continuously improve system reliability, scalability, and performance.

Requirements

What you’ll need

Strong backend engineering experience in production systems.
Experience building or operating high-throughput, low-latency services.
Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows).
Experience with distributed systems and production debugging.
Strong understanding of APIs, data flows, and system design principles.
Experience with observability tools (logging, monitoring, tracing).
Strong ownership mindset and bias toward shipping.
Comfortable working in fast-paced, globally distributed teams.

Benefits

Comp & perks

medical insurance
Dental
Vision
Savings Plan Options
PTO