Senior Backend Engineer – AI Agents

Level AI

Focusing on scalable backend systems for Level AI’s AI Agents in real-time environments. Collaboration across distributed teams to enhance customer intelligence and operational efficiency.

Posted 6/11/2026full-timeRemote • 🇺🇸 United StatesSeniorWebsite

Tech Stack

Tools & technologies

AWSAzureCloudDistributed SystemsDockerGoogle Cloud PlatformGRPCKubernetesMicroservicesNoSQLSQL

About the role

Key responsibilities & impact

Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)
Build systems for agent memory, context management, and state persistence across interactions
Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services
Implement evaluation (evals) frameworks to measure agent performance, accuracy, and reliability
Enable continuous improvement loops (feedback → retraining → deployment) for AI agents in production
Design and manage event-driven, asynchronous workflows for complex agent tasks
Optimize systems for high throughput, low latency, and cost-efficient inference at scale
Build and maintain robust APIs and service layers (REST / gRPC) for agent capabilities
Partner closely with Applied AI / ML teams to productionize models and agent behaviours
Collaborate with Product and Solutions teams to translate real customer workflows into agentic systems
Drive best practices in observability, monitoring, safety, and guardrails for AI systems
Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms

Requirements

What you’ll need

5+ years of experience in backend engineering, distributed systems, or platform engineering
Strong experience building high-scale, production-grade backend systems
Experience designing systems for real-time processing, streaming, or event-driven architectures
Strong understanding of API design (REST, gRPC) and microservices architectures
Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
Strong fundamentals in system design, concurrency, and performance optimization
Experience working with LLMs, conversational AI, or AI-powered products in production (strong plus)
Familiarity with agent frameworks, tool calling, or multi-step reasoning systems (strong plus)
Experience building or integrating RAG pipelines, vector databases, or retrieval systems (strong plus)
Exposure to evaluation systems (offline/online evals, A/B testing for AI systems) (strong plus)
Understanding of prompting strategies, context windows, and model behavior optimization (strong plus)
Experience with real-time decisioning systems or workflow orchestration engines (strong plus)

Benefits

Comp & perks

Competitive compensation with performance-based upside
Flexible vacation policy
Health insurance coverage
Work with a globally distributed, high-impact team
Opportunity to build cutting-edge AI products at scale
Regular team offsites and in-person collaboration

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

backend engineeringdistributed systemsplatform engineeringreal-time processingevent-driven architecturesAPI designmicroservices architecturesdata modelingperformance optimizationevaluation systems

Soft Skills

collaborationcommunicationproblem-solvingleadershiporganizational skillsadaptabilitycritical thinkingattention to detailcreativitystrategic thinking