Develop open source software to serve inference of trained AI models running on GPUs
Balance a variety of objectives including building robust, scalable, high performance software components to support distributed inference workloads
Work with team leads to prioritize features and capabilities
Load-balance asynchronous requests across available resources
Optimize prediction throughput under latency constraints
Integrate the latest open source technology

Requirements

Masters or PhD or equivalent experience
3+ years in Computer Science, Computer Engineering, or related field
Ability to work in a fast-paced, agile team environment
Excellent Rust/Python/C++ programming and software design skills, including debugging, performance analysis, and test design
Experience with high scale distributed systems and ML systems

Benefits

equity
benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

RustPythonC++software designdebuggingperformance analysistest designdistributed systemsML systemsopen source software

ability to work in a fast-paced environmentagile team collaboration

MastersPhD