Software Engineer, AI Networking

NVIDIA

Software Engineer optimizing AI Networking tools for NVIDIA's next generation of large-scale AI systems. Focusing on machine learning techniques and performance optimization in diverse environments.

Posted 4/25/2026full-timeSanta Clara • California, Washington • 🇺🇸 United StatesMid-LevelSenior💰 $124,000 - $195,500 per yearWebsite

Tech Stack

Tools & technologies

Distributed SystemsPythonPyTorchTensorflow

About the role

Key responsibilities & impact

Design and implement resource allocation and combinatorial optimization techniques to optimize LLM models at datacenter scale.
Research, develop, and deploy AI/ML techniques to optimize large-scale Deep Learning training and inference on NVIDIA supercomputers and distributed systems.
Build and productionize ML-based tools for performance prediction and optimization with a strong emphasis on networking.
Develop and deploy a scalable, reliable data curation pipeline capable of handling complex data types.
Collaborate across hardware and software teams to deliver valuable performance analysis insights.
Lead performance test planning, establish performance targets for new technologies and solutions, and drive efforts to achieve those performance goals.

Requirements

What you’ll need

Master's degree in Computer Science, Software Engineering, or equivalent experience.
Experience applying machine learning techniques to computer architecture and system optimization problems.
Hands-on experience developing and deploying various learning algorithms (e.g., reinforcement learning, offline RL, supervised learning).
Proficiency in building and using ML models with leading frameworks such as PyTorch, TensorFlow, or JAX.
Proven ability to apply GNNs/transformers-based optimization to PyTorch model graph and Kineto execution traces.
Expertise combining knowledge of NVIDIA GPUs, the CUDA library, and deep learning frameworks (TensorFlow/PyTorch) with networking concepts.
Strong programming capabilities in Python, Bash, and C++.

Benefits

Comp & perks

Competitive salaries
Comprehensive benefits package

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

resource allocationcombinatorial optimizationAI/ML techniquesDeep Learningperformance predictiondata curation pipelinemachine learning techniquesreinforcement learningsupervised learningprogramming in Python

Soft Skills

collaborationleadershipperformance analysis

Certifications

Master's degree in Computer ScienceMaster's degree in Software Engineering