Pryon

Senior Product Manager – Accelerated Compute Memory Systems

Pryon

full-time

Posted on:

Location Type: Remote

Location: Remote • New York • 🇺🇸 United States

Visit company website
AI Apply
Apply

Job Level

Senior

Tech Stack

Distributed Systems

About the role

  • Own the end-to-end product vision for Pryon’s HPC platform across data ingestion, retrieval, inference, compliance, and scalability.
  • Translate scale targets (thousands of concurrent requests, billions of documents, and sub-second latency) into actionable product requirements and success metrics.
  • Partner with Engineering, Security, Research and Infrastructure teams to design horizontal scalability, multimodal ingestion, and regulatory compliance (FOIA, OIG, CISA).
  • Collaborate with federal and enterprise customers to capture requirements for IL5/6 and public-facing deployments.
  • Drive roadmap alignment across ingestion, retrieval, ranking, and inference sub-tracks, ensuring delivery against Beta and GA milestones.
  • Serve as the internal and external voice of the AI platform, presenting to agency stakeholders, strategic partners, and the Pryon executive team.

Requirements

  • 10+ years in product management, with at least 5 in AI/ML infrastructure or large-scale distributed systems.
  • Proven track record building state of the art inference and RAG: direct experience delivering high-performance distributed systems at scale.
  • Deep familiarity with RAG architectures, multimodal ingestion, and LLM-backed retrieval.
  • Familiarity with HPC cluster management software such as Slurm
  • Strong background in high-throughput, low-latency production environments—ideally with petabyte-scale ingestion and real-time inference.
  • Understanding of federal compliance environments (audit logging, IL5/6 certifications).
  • Ability to balance technical depth with executive-level communication, ensuring teams and stakeholders are aligned.
Benefits
  • Remote first organization
  • 100% Company paid Health/Dental/Vision benefits for you and your dependents
  • Life Insurance, Short-term and Long-term Disability
  • 401k
  • Unlimited PTO

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
product managementAI/ML infrastructurelarge-scale distributed systemsinferenceRAG architecturesmultimodal ingestionHPC cluster managementhigh-throughput environmentslow-latency productionreal-time inference
Soft skills
executive-level communicationstakeholder alignmentcollaborationroadmap alignmentrequirement capturing
Certifications
IL5 certificationIL6 certification
Netflix

Principal Product Manager – Games, Social Platform

Netflix
Leadfull-time$440k–$1000k / year🇺🇸 United States
Posted: 18 minutes agoSource: netflix.wd1.myworkdayjobs.com
Kraken

Senior Product Manager – Outage Management

Kraken
Seniorfull-time$120k–$150k / year🇺🇸 United States
Posted: 3 hours agoSource: jobs.lever.co
Kraken

Product Manager – Vertically Integrated Utilities

Kraken
Junior · Midfull-time$80k–$120k / year🇺🇸 United States
Posted: 3 hours agoSource: jobs.lever.co
Salesforce Ventures

Product Owner – Client & Advisor Portals

Salesforce Ventures
Mid · Seniorfull-time🇺🇸 United States
Posted: 3 hours agoSource: boards.greenhouse.io
Salesforce Ventures

Product Owner – Onboarding, Workflows

Salesforce Ventures
Mid · Seniorfull-time🇺🇸 United States
Posted: 3 hours agoSource: boards.greenhouse.io