Product Manager, Token Factory

Nebius Group

Product Manager leading Nebius’s scalable ML inference capabilities for its AI cloud platform. Owning roadmap, customer PoCs, and production-grade deployment tools for distributed ML workloads.

Posted 8/5/2026full-timeRemote • 🇺🇸 United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in product management for high-load ML scenarios, with a strong technical foundation in cloud infrastructure and modern ML inference tools. Capable of translating complex customer workflows into actionable product requirements while driving adoption through robust infrastructure.

Highest-signal resume keywords

Product Management ExperienceCloud Infrastructure KnowledgeML Inference Tools FamiliarityTechnical Communication SkillsDistributed ML Pipeline Delivery

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Product Roadmap DevelopmentModel Architecture UnderstandingInference OptimizationLatency ImprovementThroughput Enhancement

Soft Skills

CollaborationCommunication

Tools & Technologies

Triton Inference ServerVLLMSGLangTensorRT-LLMDynamoKServeRay Serve

Industry Keywords

ML PlatformsDeveloper ToolsMLOpsAIOpsPerformance Optimization

Tech Stack

Tools & technologies

CloudRay

About the role

Key responsibilities & impact

Lead the definition, development, and delivery of Nebius Token Factory’s inference capabilities
Own the product roadmap for high-load, production-grade ML scenarios
Participate in customer PoCs involving distributed ML model deployment, inference orchestration, and optimization
Collaborate with engineering and research teams on scalable infrastructure for real-time and batch inference
Translate customer ML workflows and technical challenges into clear product requirements
Identify bottlenecks and define features improving latency, throughput, orchestration, and deployment efficiency
Drive product adoption through intuitive tools and robust infrastructure for real-world inference problems at scale

Requirements

What you’ll need

3–5 years of product management experience, ideally in cloud infrastructure, ML platforms, or developer tools
Strong technical foundation, such as Computer Science or Engineering knowledge, with ability to dive deep into model architectures and serving systems
Familiarity with modern ML inference tools and frameworks, including Triton Inference Server, vLLM, SGLang, TensorRT-LLM, Dynamo, KServe, and Ray Serve
Proven track record delivering technically complex products supporting distributed and high-throughput ML pipelines
Strong communication and experience working across engineering, research, and customer-facing teams
Added bonus: deep understanding of modern ML architectures, including transformer-based models and inference characteristics
Added bonus: experience delivering or supporting production ML solutions in customer-facing or solutions roles
Added bonus: knowledge of MLOps or AIOps cycles, observability, performance optimization, and continuous delivery of ML systems
Applicants must be authorized to work in the country in which they apply and provide proof of employment eligibility as a condition of hire

Benefits

Comp & perks

100% company-paid medical, dental, and vision coverage for employees and families
401(k) plan with up to 4% company match and immediate vesting
20 weeks paid parental leave for primary caregivers
12 weeks paid parental leave for secondary caregivers
Remote work reimbursement up to $85/month for mobile and internet
Company-paid short-term, long-term and life insurance coverage
Competitive compensation
Career growth and learning opportunities
Flexibility and ownership
Collaborative and innovative culture
Opportunity to work on impactful AI projects
International environment and talented teams