Senior Software Engineer, Agentic Systems

NVIDIA

Senior Software Engineer building NVIDIA's NeMo Platform for developing, evaluating, deploying, and operating AI systems at scale. Focus on NeMo Evaluator for measuring AI agent improvements.

Posted 6/4/2026full-timeRemote • California, Colorado, Massachusetts, New York, Washington • 🇺🇸 United StatesSenior💰 $184,000 - $356,500 per yearWebsite

Tech Stack

Tools & technologies

CloudDistributed SystemsDockerKubernetesPython

About the role

Key responsibilities & impact

Design and implement Python-first APIs, SDK workflows, and plugin interfaces for building, measuring, and improving agents across multiple runtimes and product surfaces
Build reusable systems for observing behavior, measuring progress, detecting regressions, and turning runtime evidence into product decisions
Build systems for ingesting, normalizing, validating, and analyzing agent execution data and evaluation datasets
Partner with research, product, platform, and infrastructure teams to integrate agentic capabilities broadly across NVIDIA agent runtimes and developer workflows
Help turn emerging agent development and improvement techniques into reliable, reusable product capabilities
Improve reliability, observability, debuggability, and performance across NeMoStack services, SDKs, plugins, jobs, and developer workflows
Build strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows
Drive 'speed of light' engineering: fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints
Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems

Requirements

What you’ll need

BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field
5+ years of professional software engineering experience building production systems
Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design
Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces
Experience with distributed systems, cloud-native services, containers, Kubernetes, or job orchestration
Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure
Experience with structured data modeling and validation systems such as Pydantic, typed schemas, event/trace models, or SDK-generated types
Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries
Clear communication skills and a track record of collaborating with engineering, product, research, or customer-facing teams.

Benefits

Comp & perks

equity
benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonAPI designSDK developmenttestingdebuggingperformance analysisstructured data modelingPydanticKubernetesdistributed systems

Soft Skills

clear communicationcollaborationindependent workproblem-solvingtechnical leadershipmentoringownershippragmatic decision-makingiteration speedcross-team collaboration

Certifications

BS in Computer ScienceMS in Computer Scienceequivalent experience in Computer Engineering