Evaluator

• Evaluate AI-generated coding interactions end-to-end
• Judge whether outputs are:
• - Useful
• - Correct (at a high level)
• - Aligned with how a strong engineer would think
• Assess the **quality of explanations and reasoning**, not just code
• Distinguish between different levels of response quality (e.g. what makes something a *2 vs 4*)
• Provide clear, opinionated feedback on:
• - What worked
• - What didn’t
• - What felt “off” or misleading
• Help define what *great* looks like when interacting with tools like Cursor

Evaluator jobs in Florida

See all jobs on JobTailor

AI Interaction Evaluator, Codex / Claude Code