Senior Research Engineer – Enterprise Products

NVIDIA

Senior Research Engineer designing and evaluating routing policies for AI inference at NVIDIA. Collaborating with engineering teams to integrate software across NVIDIA's serving stack.

Posted 7/12/2026full-timeRemote • California, Washington • 🇺🇸 United StatesSenior💰 $192,000 - $356,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Deep Learning frameworks such as PyTorch and TensorFlow, with a strong foundation in algorithms, data structures, and empirical research methodologies. Capable of designing and evaluating LLM benchmarks while effectively collaborating with cross-functional teams.

Highest-signal resume keywords

Deep Learning FrameworksLLM EvaluationsEmpirical Research MindsetStrong Communication SkillsMentoring Junior Engineers

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PyTorchTensorFlowMachine LearningDeep Neural NetworksNatural Language ProcessingSpeech RecognitionAlgorithmsData StructuresComputational ComplexityParallel Computing

Soft Skills

Strong CommunicationInterpersonal SkillsTeam CollaborationMentoring

Tools & Technologies

NVIDIA Accelerated Serving StackOpen-Source RepositoriesAgentic Benchmarks

Certifications & Qualifications

Bachelor's Degree in Computer ScienceMaster's Degree in Computer Science

Industry Keywords

Routing PoliciesAlgorithm QualityCalibration DataStatistically Sound Conclusions

Tech Stack

Tools & technologies

PyTorchTensorflow

About the role

Key responsibilities & impact

Design and evaluate routing policies for LLM traffic to best use mixture of model systems.
Build and run agentic benchmarks (e.g., Terminal-Bench ) to measure algorithm quality, and turn results into calibration data and routing profiles.
Ship to an open-source repo: design docs, code review, docs, and community contributions.
Collaborating with engineering teams across all of NVIDIA to ensure our software integrates seamlessly up and down the NVIDIA accelerated serving stack.

Requirements

What you’ll need

Bachelor's of Master's degree in Computer Science or equivalent experience.
8+ years of industry experience in Deep Learning frameworks (PyTorch or TensorFlow).
Experience designing or running LLM evaluations/benchmarks — ideally agentic ones — and drawing statistically sound conclusions from them.
Understanding of modern techniques in Machine Learning, Deep Neural Networks, Natural Language Processing, or Speech Recognition.
Empirical research mindset: forming hypotheses about new algorithms, running calibrations, iterating on results.
Strong communication and interpersonal skills, along with the ability to work in a dynamic and distributed team.
A history of mentoring junior engineers and interns is a huge plus.
A desire to constantly grow and learn new things.
Strong computer science fundamentals - algorithms and data structures, computational complexity, parallel and distributed computing, system software.

Benefits

Comp & perks

eligible for equity and benefits