Senior AI Systems and Algorithms Engineer

NVIDIA

Senior GenAI Algorithms Engineer advancing NVIDIA’s foundation models and open-source AI infrastructure. Improving distributed training, reinforcement learning, multimodal systems, and inference efficiency.

Posted 8/5/2026full-timeSanta Clara • California, Colorado, New Jersey, New York, Virginia • 🇺🇸 United StatesSenior💰 $184,000 - $287,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in foundation model development, including machine learning and deep learning, with a strong focus on optimizing large-scale AI systems. Proficient in Python and PyTorch, with experience in distributed training and contributing to open-source AI frameworks.

Highest-signal resume keywords

Foundation Model DevelopmentMachine LearningDeep LearningPython ProgrammingPyTorch Framework

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Machine LearningDeep LearningOptimizationDistributed TrainingModel CompressionQuantizationPruningNeural Architecture SearchReinforcement LearningPerformance Optimization

Soft Skills

Analytical SkillsDebugging Skills

Tools & Technologies

Megatron-LMMegatron BridgeNeMo-RLHugging Face TransformersGPU Performance Optimization

Certifications & Qualifications

MS or Ph.D in Computer ScienceAIApplied Mathematics

Industry Keywords

AI SystemsOpen-Source AI FrameworksLarge-Scale AI WorkloadsCloud PlatformsEdge Platforms

Tech Stack

Tools & technologies

CloudDistributed SystemsPythonPyTorch

About the role

Key responsibilities & impact

Advance the state of the art in foundation model development, training, and deployment
Design scalable systems for preparing high-quality multimodal datasets for frontier foundation model training
Develop algorithms and systems that improve the scalability, efficiency, and cost of large-scale pre-training and post-training
Advance techniques that improve inference performance, reduce deployment cost, and enable efficient serving across cloud and edge platforms
Develop reusable infrastructure and contribute new model support to NVIDIA's open-source GenAI training platform
Collaborate with research, product, and infrastructure teams to design new algorithms and optimize existing systems
Contribute to NVIDIA's open-source AI stack, including Megatron-LM, Megatron Bridge, and NeMo-RL

Requirements

What you’ll need

MS or Ph.D in Computer Science, AI, Applied Mathematics, or a related field (or equivalent experience)
5+ years of relevant industry experience
Strong foundation in machine learning, deep learning, and optimization
Excellent software engineering skills, including Python and PyTorch
Experience building high-performance software for large-scale AI systems
Strong analytical, debugging, and performance optimization skills
Experience with distributed training at scale, such as Megatron-LM, Megatron Bridge, FSDP, and TP/PP/CP/DP
Experience with optimizer research and efficient sparse or long-context attention
Experience with supervised fine-tuning, reinforcement learning for LLMs, PPO, GRPO, asynchronous RL, or NeMo-RL
Experience with model compression, quantization, pruning, knowledge distillation, neural architecture search, or diffusion/non-autoregressive language models
Experience contributing to open-source AI frameworks such as Megatron-LM, Megatron Bridge, NeMo-RL, or Hugging Face Transformers
Experience with GPU performance optimization, distributed systems, latency/throughput analysis, and profiling of large-scale AI workloads

Benefits

Comp & perks

Equity
Benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score