Senior Technical Product Manager – Token Factory, Inference
Nebius Group
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $204,000 - $255,000 per year
Job Level
Senior
Tech Stack
CloudRay
About the role
- Own the product roadmap for Nebius Token Factory inference capabilities, focusing on high-load, production-grade ML scenarios.
- Be involved in customer PoCs involving distributed ML model deployment, inference orchestration, and optimization.
- Work closely with engineering and research teams to shape scalable infrastructure for real-time and batch inference.
- Act as the technical voice in customer conversations, translating ML workflows into product requirements.
- Drive product adoption by delivering tools and features that solve real-world inference problems at scale.
Requirements
- 3–5 years of product management experience, ideally in cloud infrastructure, ML platforms, or developer tools.
- Strong technical foundation (e.g. Computer Science or Engineering degree) with ability to dive deep into model architectures and serving systems.
- Familiarity with modern ML inference tools and frameworks (e.g., Triton Inference Server, vLLM, SGLang, TensorRT-LLM, Dynamo, KServe, Ray Serve).
- Proven track record of delivering technically complex products that support distributed and high-throughput ML pipelines.
- Strong communicator with experience working across engineering, research, and customer-facing teams.
Benefits
- Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.
- 401(k) plan: Up to 4% company match with immediate vesting.
- Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
- Remote work reimbursement: Up to $85/month for mobile and internet.
- Disability & life insurance: Company-paid short-term, long-term and life insurance coverage.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
product managementcloud infrastructureML platformsmodel architecturesserving systemsdistributed ML model deploymentinference orchestrationinference optimizationhigh-throughput ML pipelines
Soft skills
strong communicatorcollaborationcustomer engagement
Certifications
Computer Science degreeEngineering degree