Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
Own infrastructure for model integration, routing, and evaluation.
Build evaluation frameworks and tooling for AI quality improvement.
Partner closely with product engineering teams to launch AI products.
Evaluate, prototype, and integrate advancements in AI and agentic systems.

Requirements

5+ years of experience building backend systems
At least 1+ year focused on AI/ML engineering
Experience building and shipping multi-model or multi-provider AI systems in production
Familiarity with context management, session state, or memory systems in AI or distributed systems
A track record of building internal platforms, SDKs, or shared infrastructure that other engineering teams adopted
Strong judgment about abstractions
Excitement about agentic AI and the infrastructure challenges of making autonomous systems reliable
A bias toward full ownership
Bonus: experience building evaluation frameworks or familiarity with legal or high-stakes domains

Benefits

Comprehensive health, dental and vision coverage
Retirement benefits (401k match up to 4%)
Flexible PTO
Eligible to participate in our equity plan and benefits program

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

backend systemsAI engineeringML engineeringmulti-model AI systemsmulti-provider AI systemsevaluation frameworkscontext managementsession statememory systemsinternal platforms

Soft Skills

strong judgmentexcitement about agentic AIownership