Engineering Manager, Agent Infrastructure
Replit
Distributed SystemsJavaScriptOpen SourceTypeScript
Senior Product Manager - Inference Benchmarking
NVIDIA
full-time
Posted on:
Origin: • 🇺🇸 United States • California
Visit company websiteSalary
💰 $208,000 - $327,750 per year
Job Level
Senior
Tech Stack
Distributed SystemsSwift
About the role
- Serve as a Subject Matter Expert on AI Inference: Maintain a deep understanding of the entire inference stack, including performance, scaling across workloads, and emerging technologies like disaggregated serving, to guide technical and product strategy.
- Drive Product Strategy through Market and User Insights: Steer product evolution and partnership direction by conducting thorough research on market trends, competitor activities, and customer feedback, translating these insights into actionable development plans and innovative ideas.
- Lead Partner Collaboration and Project Execution: Actively manage external partnerships by leading project planning, defining specific tasks and deliverables, serving as the primary liaison for communication, and educating partners on product value to ensure alignment and swift issue resolution.
- Spearhead Cross-Functional Product Introduction: Drive the new product introduction and transition processes by collaborating seamlessly with engineering, design, operations, sales, and marketing teams, ensuring a unified approach from conception to launch.
- Enhance Product and User Experience: Play a key role in the product development lifecycle by contributing to the ideation, design, and testing of user experiences, ensuring the final product meets and exceeds customer and partner expectations.
Requirements
- BS or MS in Computer Science, Computer Engineering, or a related team (or equivalent experience)
- 12+ years of product‑management experience in enterprise technology
- Be a subject matter expert on Inference
- Understand different components of the inference stack, how they perform, scale, and correlate to workloads
- Ability to articulate trade‑offs among latency, throughput, cost, and reliability to both engineering and executive audiences
- Strong cross‑functional execution: writes clear specs and PRDs, produces GTM collateral, and leads agile processes
- Masters/PhD or Expertise in distributed systems or Demonstrated experience in Inference (ways to stand out)
