Senior, Staff AI Model Engineer

Clear Street

Senior AI Model Engineer ensuring reliability and quality in an AI copilot for trading platform. Collaborating with engineering and product teams to maintain benchmarks and evaluation systems.

Posted 7/9/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $200,000 - $350,000 per yearWebsite

About the role

Key responsibilities & impact

You will own the reliability and quality bar for an AI copilot embedded in an trading platform used by sophisticated investors
You will design and build evaluation systems that measure correctness, safety, latency, and regression risk across market analysis, portfolio/risk reasoning, and trading workflows (including order placement)
You will develop and maintain benchmarks: curated “golden sets,” scenario suites, stress/adversarial cases, and continuously refreshed market/regime-based test corpora
You will build automated quality gates and regression workflows that block releases when key metrics degrade
You will partner with engineering and product to define safe tool/action contracts (deterministic previews, confirmations, auditability) and ensure predictable assistant behavior
You will own model improvement loops tied to evals: data collection/labeling strategies, error taxonomy, prompt/tooling changes, and when appropriate, fine-tuning or preference optimization to measurably improve benchmark performance
You will design and operate monitoring + incident response for AI: telemetry, alerting, RCA, and “fix-forward” processes
You will develop a deep understanding of trading concepts (margin, shorting, portfolio margin, risk, execution) and how to express them accurately and understandably to users

Requirements

What you’ll need

At least Eight (8) years of experience shipping production software; strong proficiency with any programming language
Strong knowledge of computer science fundamentals, testing methodology, and systems design
Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems (LLMs/agents/search/retrieval/ranking/recommenders)
Experience running model improvement cycles: dataset curation, labeling/QA, offline experimentation, and deploying changes with measurable impact on benchmarks
Ability to define metrics, build measurement pipelines, and drive engineering/product decisions from data
Comfort working across the stack: debugging model/tooling failures, instrumenting services, and partnering with frontend/product on UX patterns that improve safety and trust
High degree of self-motivation and willingness to jump into unfamiliar areas to solve problems

Benefits

Comp & perks

Competitive compensation packages
Company equity
401k matching
Gender neutral parental leave
Full medical, dental and vision insurance
Lunch stipends
Fully stocked kitchens
Happy hours
Great location
Amazing views

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Programming Language ProficiencyComputer Science FundamentalsSystems DesignEvaluation FrameworksTest HarnessesModel Improvement CyclesMetrics DefinitionMeasurement PipelinesDebuggingData-Driven Decision Making

Soft Skills

Self-MotivationProblem SolvingCollaboration