Senior Deep Learning Systems Engineer, Datacenters

NVIDIA

Senior Deep Learning Systems Engineer optimizing datacenters for AI applications and deep learning software. Analyzing performance and power consumption of applications on datacenter-class hardware.

Posted 5/8/2026full-timeSanta Clara • California, Washington • 🇺🇸 United StatesSenior💰 $184,000 - $356,500 per yearWebsite

Tech Stack

Tools & technologies

DockerLinuxPythonPyTorchTensorflow

About the role

Key responsibilities & impact

Help develop software infrastructure to characterize and analyze a broad range Deep Learning applications
Evolve cost-efficient datacenter architectures tailored to meet the needs of Large Language Models (LLMs).
Work with experts to help develop analysis and profiling tools in Python, bash and C++ to measure key performance metrics of DL workloads running on Nvidia systems.
Analyze system and software characteristics of DL applications.
Develop analysis tools and methodologies to measure key performance metrics and to estimate potential for efficiency improvement.

Requirements

What you’ll need

A Bachelor’s degree in Electrical Engineering or Computer Science or equivalent experience (Masters or PhD degree preferred).
8 years or more of relevant experience.
Experience in at least one of the following: System Software: Operating Systems (Linux), Compilers, GPU kernels (CUDA), DL Frameworks (PyTorch, TensorFlow).
Silicon Architecture and Performance Modeling/Analysis: CPU, GPU, Memory or Network Architecture.
Experience programming in C/C++ and Python.
Exposure to Containerization Platforms (docker) and Datacenter Workload Managers (slurm) is a plus.
A deep understanding of computer system architecture and performance analysis is essential for success in this role.
Applicants should have demonstrated hands-on experience in these domains.
Demonstrated ability to work in virtual environments, and a strong drive to own tasks from beginning to end.
Prior experience with such environments will make you stand out.

Benefits

Comp & perks

equity
benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Deep LearningPythonC++LinuxCUDAPyTorchTensorFlowSystem SoftwarePerformance AnalysisSilicon Architecture

Soft Skills

analytical skillsproblem-solvingtask ownershipcollaborationcommunication

Certifications

Bachelor’s degreeMaster’s degreePhD