Harvey

Senior Product Manager, Data & Retrieval

Harvey

full-time

Posted on:

Location Type: Hybrid

Location: San Francisco • California • United States

Visit company website

Explore more

✨ AI Apply
Apply

Salary

💰 $178,500 - $241,500 per year

Job Level

Senior

About the role

  • Drive the roadmap and strategy for Harvey’s “Data Factory”, ensuring we scale our data 100x through new platforms that build the ‘legal index’ of the world
  • Work with internal operations and external data providers to methodically expand coverage, accelerate execution, and improve dataset quality.
  • Own and evolve Harvey’s end-to-end data architecture—from ingestion and transformation to storage, indexing, and retrieval—ensuring performance, reliability, and scalability for LLM-powered products.
  • Partner with Applied AI engineers to build and optimize retrieval systems, embeddings, search models, and evaluation frameworks.
  • Architect and oversee large-scale ingestion pipelines that aggregate, normalize, and continuously update millions of heterogeneous legal documents across global jurisdictions.
  • Collaborate cross-functionally with Product Engineering, Applied AI, Research, and Platform teams to deliver high-quality production systems that support reasoning, summarization, and legal research workflows.

Requirements

  • 5+ years of experience building or managing search, retrieval, recommendation, or data platforms at scale.
  • Experience working with complex, heterogeneous, or domain-specific datasets with structured + unstructured data.
  • Understanding of modern retrieval methods, including hybrid search (lexical + vector), dense retrieval, re-ranking, embeddings, chunking strategies, and index optimization.
  • Hands-on experience with LLMs or RAG frameworks (evaluation, grounding, hybrid pipelines, query rewriting, LLM-as-a-judge, retrieval metrics).
  • Ability to partner with engineers on technical architecture, with enough depth to challenge assumptions, propose solutions, and influence design.
  • A product mindset for search—balancing user needs, domain complexity, and system constraints to propose high-leverage improvements.
Benefits
  • Comprehensive health, dental and vision coverage
  • Retirement benefits (401k match up to 4%)
  • Flexible PTO
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
data architecturedata ingestiondata transformationdata storagedata indexingdata retrievalsearch modelsembeddingsLLMsRAG frameworks
Soft Skills
collaborationstrategic thinkingproblem-solvinginfluencingproduct mindset