NVIDIA

Principal Software Engineer – Dynamo

NVIDIA

full-time

Posted on:

Location Type: Remote

Location: Remote • California • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Salary

💰 $272,000 - $425,500 per year

Job Level

Lead

Tech Stack

C++CloudDistributed SystemsDockerGoKubernetesNode.jsPythonRust

About the role

  • Collaborate on the design and development of the Dynamo Kubernetes stack
  • Introduce new features to the Dynamo Python SDK and Dynamo Rust Runtime Core Library
  • Design, implement, and optimize distributed inference components in Rust and Python
  • Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM, llama.cpp, mistral.rs)
  • Improve intelligent routing and KV-cache management subsystems
  • Contribute to open-source repositories, participate in code reviews, and assist with issue triage on GitHub
  • Work closely with the community to address issues, capture feedback, and evolve the framework’s APIs and architecture
  • Write clear documentation and contribute to user and developer guides.

Requirements

  • BS/MS or higher in computer engineering, computer science or related engineering (or equivalent experience)
  • 15+ years of proven experience in related field
  • Strong proficiency in systems programming (Rust and/or C++)
  • Experience in Python for workflow and API development
  • Experience with Go for Kubernetes controllers and operators development
  • Deep understanding of distributed systems, parallel computing, and GPU architectures
  • Experience with cloud-native deployment and container orchestration (Kubernetes, Docker)
  • Experience with large-scale inference serving, LLMs, or similar high-performance AI workloads
  • Background with memory management, data transfer optimization, and multi-node orchestration
  • Familiarity with open-source development workflows (GitHub, continuous integration and continuous deployment)
  • Excellent problem-solving and communication skills.
Benefits
  • Highly competitive salaries
  • Comprehensive benefits package
  • Equity
  • Health insurance
  • Paid time off
  • Professional development opportunities

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
RustPythonC++GoKubernetesDockerdistributed systemsparallel computingGPU architectureslarge-scale inference serving
Soft skills
problem-solvingcommunication
Certifications
BS/MS in computer engineeringBS/MS in computer science