AI Project Reviewer – CONTRACT

MasterClass

AI Project Reviewer evaluating learner submissions for MasterClass, a streaming platform featuring expert-led classes. Applying rubrics, making pass/fail judgments, and improving assessment feedback.

Posted 8/18/2026contractRemote • California, New York, Washington • 🇺🇸 United StatesMid-LevelSenior💰 $75 - $125 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in assessment and evaluation within educational contexts, with a strong focus on providing constructive feedback and maintaining consistency in judgment. Possesses excellent written communication skills and a commitment to learner success.

Highest-signal resume keywords

Assessment ExperienceWritten Communication SkillsConstructive Feedback ProvisionMentoring or Coaching ExperienceAttention to Detail

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

EvaluationRubric ApplicationFeedback WritingIndependent WorkTime Management

Soft Skills

Strong CommunicationCuriosityOpenness to AI Methods

Industry Keywords

Educational EvaluatorTeaching AssistantConsultant in AILearning DesignInstructor

About the role

Key responsibilities & impact

Review and evaluate learner projects against detailed rubrics and provide consistent pass/fail judgments
Write clear, actionable feedback to help learners understand areas for improvement
Collaborate with learning design and product teams to refine rubrics and assessment criteria
Compare human and AI assessment outcomes to identify areas for calibration
Document the reasoning behind evaluation decisions to support assessment consistency

Requirements

What you’ll need

5+ years of experience in assessment, evaluation, or educational feedback roles
Ability to consistently apply detailed rubrics across multiple submissions
Strong written communication skills and ability to articulate reasoning clearly
Experience providing constructive feedback to support learner growth
Ability to work independently while maintaining high standards
Willingness to refrain from using AI during evaluations and written rationales
Experience as a Mentor or Coach in educational settings, Educational Evaluator or Teaching Assistant, Consultant in AI or learning design, or Instructor with grading and feedback experience
Passion for education and commitment to helping learners succeed
Keen attention to detail and high standards in evaluation
Comfort making nuanced judgments while ensuring consistency
Experience working independently and managing time efficiently
Curiosity and openness to AI-driven evaluation methods

Benefits

Comp & perks

Flexible engagement based on project needs
Approximately 20 hours per week
Freelance/temporary project-based work
Hourly compensation of $75-$125 USD
Equal employment opportunity workplace
Reasonable accommodations for qualified individuals with disabilities