Senior Product Manager – AI Systems, Context
MagicSchool AI
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $160,000 - $200,000 per year
Job Level
Senior
Tech Stack
Distributed Systems
About the role
- Define and own the product strategy for context, memory, and retrieval systems that determine what information AI agents see, how they maintain continuity, and how they ground responses from structured and unstructured data.
- Partner with Context Engineering and Knowledge Graph Engineering to translate advanced technical capabilities - dynamic retrieval, context compaction, graph-powered reasoning - into clear product requirements, evaluation frameworks, and shipped features.
- Drive end-to-end development of context pipelines and AI reasoning systems to ensure products balance token efficiency, retrieval precision, and real-world classroom reliability.
- Design measurement frameworks for context quality, retrieval performance, knowledge grounding, and long-horizon coherence; use these to prioritize improvements and safeguard product correctness.
- Represent educators and classroom workflows with deep empathy and collaboration, defining which information and tools are needed to power effective AI assistance across lesson planning, differentiation, assessment, and complex multi-step tasks.
Requirements
- 5+ years of product management experience, including ownership of platform, AI systems, agentic workflows, retrieval systems, or technically complex backend products.
- Strong understanding of AI context management, including experience with LLMs, agent architectures, prompt strategies, context windows, embeddings, retrieval-augmented generation (RAG), memory systems, or structured knowledge representations.
- Technical fluency with data systems, with familiarity in knowledge graphs, database optimization, entity/relation modeling, retrieval pipelines, and relevance/tuning concepts.
- Ability to partner deeply with engineering, translating distributed systems constraints, retrieval models, and graph architectures into product strategy and requirements.
- Experience using both qualitative and quantitative data (eval metrics, retrieval quality, latency, token usage, performance degradation) to drive product decisions.
- Exceptional execution and prioritization skills, especially in highly technical environments with complex interdependencies across engineering, research, and platform teams.
- Clear, persuasive communication skills, able to align partners across engineering, research, education, and product on highly technical concepts.
Benefits
- Unlimited time off to empower our employees to manage their work-life balance.
- Choice of employer-paid health insurance plans so that you can take care of yourself and your family.
- Dental and vision are also offered at very low premiums.
- Every employee is offered generous stock options, vested over 4 years.
- 401k match & monthly wellness stipend.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
product managementAI systemscontext managementretrieval systemsdata systemsknowledge graphsdatabase optimizationretrieval pipelinesevaluation metricsperformance degradation
Soft skills
execution skillsprioritization skillscommunication skillscollaborationempathy