NVIDIA

Senior Software Engineer, NIM Integrations

NVIDIA

full-time

Posted on:

Origin:  • 🇺🇸 United States • California

Visit company website
✨ AI Apply
Apply

Salary

💰 $184,000 - $356,500 per year

Job Level

Senior

Tech Stack

MicroservicesOpen Source

About the role

  • Lead the design and implement NVIDIA Inference connectors, Toolkit integrations in upstream OSS libraries and frameworks
  • Continued maintenance of NVIDIA Inference API Integrations into upstream OSS libraries and frameworks
  • Design and develop test harness to maintain high quality integrations
  • Evangelize NVIDIA Inference API and NVIDIA Inference connectors and integrations
  • Learn and have a good understanding of NVIDIA Inference microservices, release cadence and enable day-0 support for NVIDIA models in upstream projects
  • Partner closely with NVIDIA Inference microservices and release teams to design and enable inference API integrations into upstream projects
  • Work with product to continuously discover, learn new upstream projects and enable integrations
  • Mentor junior engineers and review contributions

Requirements

  • Bachelors or Masters degree in Computer Science or a related field, or equivalent experience
  • 8+ years of experience in software design, development and test
  • Experience in open source development and releases
  • Experience working with upstream open source projects and communities
  • A good understanding of AI application Developer workflows, Inference frameworks, services and APIs
  • Strong verbal and written communication skills
  • Strong teamwork and social skills
  • Ability to adapt quickly in a dynamic environment
  • Action driven with strong analytical skills
  • Desire to be involved in multiple diverse projects
  • Background and strong contributions to open source projects (preferred)
  • Deep Understanding and contributions to open source inference ecosystem libraries, APIs and frameworks (preferred)
Docker, Inc

Senior Software Engineer, AI Gateway

Docker, Inc
Seniorfull-time$190k–$261k / year🇨🇦 Canada
Posted: 20 days agoSource: jobs.ashbyhq.com
AWSCloudDockerGoKubernetesMicroservicesRust
SFEIR

Senior Web Engineer

SFEIR
Seniorfull-time🇱🇺 Luxembourg
Posted: 6 days agoSource: jobs.lever.co
AngularAWSCloudJavaScriptMicroservicesOpen SourceReactTypeScriptVue.js
Docker, Inc

Staff Software Engineer, AI Gateway

Docker, Inc
Leadfull-time$200k–$276k / year🇺🇸 United States
Posted: 26 days agoSource: jobs.ashbyhq.com
AWSCloudDockerGoKubernetesMicroservicesRust
Invisible Technologies

Coding Specialist, Fluent in Marathi – AI Trainer

Invisible Technologies
Mid · Seniorcontract$8–$65🌎 Anywhere in the World
Posted: 27 days agoSource: boards.greenhouse.io
CloudDistributed Systems
Euna Solutions

Solutions Architect, GenAI

Euna Solutions
Senior · Leadfull-time🇺🇸 United States
Posted: 3 days agoSource: euna.bamboohr.com
AWSAzureCloudKubernetesMicroservices