Senior AI Infrastructure Engineer – DGX Cloud

NVIDIA

Senior AI Infrastructure Engineer at NVIDIA designing and maintaining large-scale production systems for AI cloud infrastructure. Ensuring reliability and performance in GPU cloud services through effective engineering practices.

Posted 7/9/2026full-timeSanta Clara • California • 🇺🇸 United StatesSenior💰 $152,000 - $241,500 per yearWebsite

Tech Stack

Tools & technologies

CloudDistributed SystemsGoJavaLinuxNode.jsPythonTerraform

About the role

Key responsibilities & impact

Design, build, deploy, and run internal tooling for large-scale AI training and inferencing platform built on top of cloud infrastructure.
Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation, and refinement.
Support services before they become available through activities such as system design consulting, developing software tools, platforms, and frameworks, capacity management, and launch reviews.
Maintain services once they are live by measuring and monitoring availability, latency, and overall system health.
Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity.
Practice sustainable incident response and blameless postmortems.
Be part of an on-call rotation to support production systems.

Requirements

What you’ll need

BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience.
5+ years of experience.
A track record showing a good balance between initiating your own projects, convincing others to collaborate with you, and collaborating well on projects initiated by others.
Background in infrastructure automation and distributed systems architecture focused on building tools to manage large-scale private or public cloud platforms in production.
Experience working with one or more of the following languages: Python, Go, C/C++, Java.
Comprehensive understanding in one or more of Linux, Networking, Storage, and Containers Technologies.
Experience with Public Cloud and Infrastructure as a Code (IAAC) and Terraform.
Distributed system experience.

Benefits

Comp & perks

Equity
Benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

C/C++ ProgrammingJava ProgrammingPerformance CharacterizationSystem DesignCapacity ManagementMonitoring and MeasurementIncident ResponseBlameless PostmortemsMulti-GPU ClustersMulti-Node Clusters

Soft Skills

CollaborationProject InitiationCommunication