Senior Software Engineer, ML Infrastructure
LMArena
full-time
Posted on:
Location Type: Hybrid
Location: Bay Area • California • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
Distributed Systems
About the role
- Architect and scale high-performance, real-time API and data systems
- Design and implement low-latency pipelines to process and analyze large-scale event streams
- Ensure reliability through robust data integrity, availability, and consistency mechanisms
- Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
- Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems
Requirements
- 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
- Deep expertise in distributed systems, stream processing, and scalable backend architecture
- Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
- Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
- Comfortable in a dynamic, high-ownership, fast-growth environment
Benefits
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- The opportunity to work on cutting-edge AI with a small, mission-driven team
- A culture that values transparency, trust, and community impact
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
API designdata systemslow-latency pipelinesevent stream processingdata integrityavailability mechanismsperformance tuningdistributed systemsscalable backend architecturefault-tolerant systems
Soft skills
mentoringcollaborationcross-functional teamworkanticipation of infrastructure needsguidance