Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA

Product Architect designing Kubernetes-based AI infrastructure for NVIDIA’s accelerated computing platform. Shaping scalable architectures, prototypes, and AI solutions from concept through lifecycle.

Posted 8/20/2026full-timeRemote • California • 🇺🇸 United StatesSenior💰 $184,000 - $356,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in architecting datacenter-scale HPC and AI infrastructure, with a strong focus on performance, scalability, and interoperability. Proven ability to lead high-impact projects, collaborate across teams, and communicate complex technical concepts effectively.

Highest-signal resume keywords

Datacenter-Scale HPC ArchitectureDevOps SolutionsPython ProgrammingKubernetes ManagementAI Workloads Familiarity

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI Infrastructure ArchitecturePerformance OptimizationScalability DesignInteroperability SolutionsPrototyping and TestingTechnical DocumentationModel EvaluationLarge Scale TrainingFine-Tuning TechniquesComplex Systems Management

Soft Skills

Exceptional CommunicationCollaborationFeedback IterationProblem-SolvingPassion for Technology Trends

Tools & Technologies

AnsibleContainer RuntimesData Center DeploymentsNetworking EcosystemsCompute EcosystemsStorage Ecosystems

Certifications & Qualifications

Advanced Certifications in AIPublications in Deep Learning

Industry Keywords

AI InfrastructureAgentic AIHPC SystemsProof-of-Concepts (POCs)Minimum Viable Products (MVPs)

Tech Stack

Tools & technologies

AnsibleKubernetesPython

About the role

Key responsibilities & impact

Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
Lead prototyping and testing processes to validate product design and functionality, focusing on scale, diagnosing bottlenecks, and driving performance innovations
Iterate and refine designs based on feedback, testing results, and evolving requirements
Collaborate with internal hardware, software, security, and systems teams to integrate networking, compute, and storage ecosystems
Work with partners and customers to conceptualize solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs)
Provide comprehensive product design documentation, including technical specifications and user guides
Develop whitepapers, blogs, and curriculum for customers, partners, and users

Requirements

What you’ll need

8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
Bachelors degree in computer science or related field (or equivalent experience)
Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
A passion for staying updated with the latest technological advancements in AI and related fields
Prior first-hand experience having built large scale AI infrastructure
Advanced certifications or publications in AI, deep learning, or related fields
Experience leading high-impact projects or initiatives in cutting-edge tech domains

Benefits

Comp & perks

Equity
Benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score