Evaluations Operations Analyst – Contract

Cartesia

Evaluations Operations Analyst at Cartesia supporting evaluation operations for AI model development. Managing annotator tasks and coordinating workforce efforts for quality assurance.

Posted 6/23/2026contractRemote • California • 🇺🇸 United StatesMid-LevelSenior💰 $25 - $35 per hourWebsite

About the role

Key responsibilities & impact

Serve evaluation tasks to our annotator workforce and manage assignment distribution across projects and locales.
Track and verify completion of assignments, flagging delays or issues before they become blockers.
Act as a first line of support for evaluators, fielding operational questions about project setup, platform access, and task instructions.
Help maintain project trackers, assignment records, and operational documentation.
Support calibration workflows as needed to ensure evaluation data meets our quality bar.

Requirements

What you’ll need

Experience managing or coordinating annotator workforces, including task assignment, scheduling, and follow-up.
Hands-on experience with data annotation platforms.
Strong written communication skills, particularly in coordinating with globally distributed contractor workforces in different time zones and language groups.
Ability to work independently and manage your own time effectively to meet tight project deadlines.
Comfort working in spreadsheets, task management tools (e.g., Asana), and messaging platforms (e.g., Slack).

Benefits

Comp & perks

Competitive base salary alongside attractive equity package.
Fully covered medical insurance along with dental and vision for you and your family.
9 weeks paternity & 12 weeks maternity leave
401(k)
A monthly stipend to help you get to and from the office.
Take as much time as you need to recharge your batteries.
Lunch, dinner and plenty of snacks, provided daily.
Your own personal Yoshi

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data annotationtask assignmentschedulingproject trackingoperational documentation

Soft Skills

written communicationindependent worktime management