Software Engineer – GPU Fabric Observability

Baseten

Lead Software Engineer at Baseten developing observability systems for GPU fabrics. Focus on high-volume telemetry and real-time diagnostics in a collaborative environment.

Posted 7/7/2026full-timeSan Francisco • California • 🇺🇸 United StatesMid-LevelSenior💰 $200,000 - $380,000 per yearWebsite

Tech Stack

Tools & technologies

Distributed SystemsKubernetes

About the role

Key responsibilities & impact

Own Baseten’s GPU fabric observability and root-cause analysis architecture.
Build telemetry pipelines across switches, NICs, hosts, GPUs, Kubernetes, and inference services.
Model topology, flow paths, service ownership, and failure domains.
Separate true fabric faults from host, NIC, GPU, kernel, driver, RDMA, scheduler, and workload failures.
Create clear operator workflows for triage, remediation, and post-incident learning.

Requirements

What you’ll need

Staff-level or senior staff-level experience building production infrastructure software.
Strong distributed systems background, especially streaming systems, telemetry pipelines, diagnostics, or control-plane software.
Experience building systems that process high-volume, high-cardinality, noisy operational data.
Understanding of networking fundamentals and high-performance networks
Ability to work with low-level infrastructure signals and build practical correlation, anomaly detection, or root-cause analysis systems.

Benefits

Comp & perks

Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Telemetry PipelineRoot-Cause AnalysisAnomaly DetectionHigh-Volume Data ProcessingDistributed SystemsControl-Plane SoftwareDiagnosticsKubernetesGPU Fabric ObservabilityOperational Data Analysis

Soft Skills

Clear CommunicationProblem-Solving