Senior System Software Architect, Enterprise Reference Architectures

NVIDIA

Senior System Software Architect at NVIDIA defining enterprise AI factory reference architectures. Leading cross-functional teams to design scalable AI solutions for data centers and cloud environments.

Posted 5/19/2026full-timeSanta Clara • California, Colorado, Massachusetts, Texas • 🇺🇸 United StatesSenior💰 $208,000 - $327,750 per yearWebsite

Tech Stack

Tools & technologies

CloudDockerKafkaKubernetesRabbitMQSwitching

About the role

Key responsibilities & impact

Define and drive full-stack enterprise AI factory baseline architectures across compute, networking, storage, virtualization, orchestration, security, observability, and NVIDIA AI software to deliver on-prem cloud native-platform and cluster reference builds.
Architect reference builds for end-to-end software systems and platforms based on scalable, portable, and resilient builds and drive evaluation of different platforms, capture information on differences in implementations, and conduct research on the platform behavior under different workloads.
Work with Product Management, Product Architects, Engineering, Solution Architecture, Program Management, and field teams to develop product direction, architecture requirements, roadmap inputs, and execution plans.
Develop and validate scalable cluster designs for enterprise AI/ML systems, including on-premises and hybrid-cloud deployments optimized for training, fine-tuning, inference, agentic AI, physical AI, and HPC workloads.
Evaluate tradeoffs across performance, scalability, resiliency, manageability, security, power, cooling, cost, TCO, and operational complexity.
Understand design patterns, fundamental business logic, component-based architecture, and evolutionary architecture.
Build and detail comprehensive API strategies, middleware integrations, and orchestration workflows to ensure seamless communication across distributed enterprise software.
Integrate with non-cloud technologies and third-party vendor products/services.

Requirements

What you’ll need

Bachelor's degree or equivalent experience.
12+ years of software or infrastructure architecture experience.
3+ years of experience with micro-services architectures.
Experience with system architecture, performance, and networking specifically developing and deploying distributed solutions.
Proven experience designing, building, or maintaining complex AI, HPC, or cloud-native infrastructure from rack-scale systems through full data center deployments.
Proven expertise in crafting and deploying complete software platforms spanning edge, on-premises, and cloud environments.
Strong understanding of GPU-accelerated systems, high-density servers, PCIe, NVLink, CPU/GPU platform design, rack integration, power, cooling, mechanical constraints, and data center deployment realities.
Deep networking knowledge across Ethernet, InfiniBand, RDMA, RoCE, routing, switching, congestion control, network segmentation, and high-performance cluster fabrics.
Deep proficiency in modern integration patterns, event-driven architectures (e.g., Kafka, RabbitMQ), and container orchestration (e.g., Kubernetes, Docker).
Strong grasp of cloud-native systems with emphasis on high availability, scalability, and security in compute environments.

Benefits

Comp & perks

Equity
Benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

full-stack architectureAI factory architecturemicro-services architectureAI/ML systems designHPC workloadsAPI strategiesmiddleware integrationsGPU-accelerated systemsevent-driven architecturecloud-native infrastructure

Soft Skills

collaborationcommunicationproblem-solvingstrategic planningresearch skillsevaluation skillsarchitectural designproject managementleadershipadaptability

Certifications

Bachelor's degree12+ years architecture experience3+ years micro-services experience