AI Rater Guidelines Writer, Linguist, Instructional Designer

Weekday (YC W21)

AI Rater Guidelines Writer engaged in transforming complex program requirements into clear guidelines. Contributing to high-quality AI training for diverse industries.

Posted 7/29/2026contractRemote • 🇺🇸 United StatesMid-LevelSenior💰 $45 - $65 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in creating and refining evaluation guidelines and rating rubrics for AI tasks, with a strong focus on clarity and usability. Possesses exceptional written communication skills to translate complex domain-specific knowledge into structured documentation.

Highest-signal resume keywords

Evaluation Guidelines CreationRating Rubric DevelopmentTechnical WritingAnalytical ThinkingSubject Matter Expertise

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

LinguisticsInstructional DesignAI Content DevelopmentGenerative AIRLHFAI Data AnnotationDocumentation RevisionEvaluation Framework DesignClarity ImprovementComplex Scenario Documentation

Soft Skills

Attention to DetailOutstanding Written CommunicationCollaboration

Industry Keywords

FinanceRetailInsuranceLegalSports

About the role

Key responsibilities & impact

Translate complex and ambiguous program requirements into clear, concise, and easy-to-follow rater guidelines.
Design comprehensive evaluation rubrics and scoring frameworks that enable consistent decision-making across a variety of AI tasks.
Review existing documentation to identify ambiguity, inconsistencies, contradictions, and coverage gaps, then revise guidelines to improve clarity and usability.
Convert subject-matter requirements from domains such as finance, retail, insurance, legal, and sports into structured evaluation instructions that non-domain raters can apply confidently.
Collaborate with research teams, program managers, and subject matter experts to maintain consistency across multiple guideline sets.
Develop documentation that addresses edge cases, exceptions, and complex evaluation scenarios while minimizing reviewer escalation.

Requirements

What you’ll need

Minimum 3 years of professional experience in Linguistics, Instructional Design, Technical Writing, AI Content Development, or a closely related field.
Direct experience creating, refining, or maintaining evaluation guidelines, rating rubrics, or reviewer instructions within Generative AI, RLHF, human evaluation, or AI data annotation environments.
Demonstrated ability to work across multiple subject areas and convert domain-specific knowledge into clear, structured documentation.
Proven experience resolving ambiguity and improving written specifications with measurable before-and-after improvements.
Strong analytical thinking with exceptional attention to detail.
Demonstrated career progression and professional growth.
Ability to commit reliably to 35+ hours per week during weekdays.
Outstanding written communication skills with the ability to explain nuanced concepts in a precise, consistent, and easy-to-understand manner.

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Weekday (YC W21) Website LinkedIn All Job Openings 11 - 50 employees Founded 2021 💼 Consulting 👥 HR Tech ☁️ SaaS Consulting
HR Tech
SaaS Weekday is a modern recruitment platform that combines AI technologies with a vast database of potential candidates, aiming to streamline the hiring process for companies in India. They offer various services, including a proactive outreach approach that helps employers connect with top talent, as well as tools for candidates to easily apply for jobs. Weekday's emphasis on candidate engagement through multiple channels, including email, WhatsApp, and phone calls, sets it apart in the competitive landscape of recruitment agencies. AI Rater Guidelines Writer, Linguist, Instructional Designer Job not on LinkedIn 🔥 3 minutes ago 🇺🇸 United States – Remote 💵 $45 - $65 / hour ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior ✏️ Content Writer Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Translate complex and ambiguous program requirements into clear, concise, and easy-to-follow rater guidelines.
Design comprehensive evaluation rubrics and scoring frameworks that enable consistent decision-making across a variety of AI tasks.
Review existing documentation to identify ambiguity, inconsistencies, contradictions, and coverage gaps, then revise guidelines to improve clarity and usability.
Convert subject-matter requirements from domains such as finance, retail, insurance, legal, and sports into structured evaluation instructions that non-domain raters can apply confidently.
Collaborate with research teams, program managers, and subject matter experts to maintain consistency across multiple guideline sets.
Develop documentation that addresses edge cases, exceptions, and complex evaluation scenarios while minimizing reviewer escalation. 🎯 Requirements
Minimum 3 years of professional experience in Linguistics, Instructional Design, Technical Writing, AI Content Development, or a closely related field.
Direct experience creating, refining, or maintaining evaluation guidelines, rating rubrics, or reviewer instructions within Generative AI, RLHF, human evaluation, or AI data annotation environments.
Demonstrated ability to work across multiple subject areas and convert domain-specific knowledge into clear, structured documentation.
Proven experience resolving ambiguity and improving written specifications with measurable before-and-after improvements.
Strong analytical thinking with exceptional attention to detail.
Demonstrated career progression and professional growth.
Ability to commit reliably to 35+ hours per week during weekdays.
Outstanding written communication skills with the ability to explain nuanced concepts in a precise, consistent, and easy-to-understand manner. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Contract Writer – A Book to Guide Women Who Fear Making the Wrong Decision 🔥 3 hours ago GRACE ENTERPRISES, LLC 1 - 10 🏥 Healthcare ⚕️ Healthcare Insurance 🧘 Wellness Website LinkedIn All Job Openings Contract Writer developing a Christ-centered book guiding women who fear making wrong decisions. Researching, outlining, and writing manuscripts while collaborating with an editorial team. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior ✏️ Content Writer Contract Writer – Body Image 🔥 3 hours ago GRACE ENTERPRISES, LLC 1 - 10 🏥 Healthcare ⚕️ Healthcare Insurance 🧘 Wellness Website LinkedIn All Job Openings Contract writer developing a Christ-centered book focused on women's body image issues in an aesthetics-obsessed culture. Collaboration with editorial team and alignment with theological perspectives. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior ✏️ Content Writer Contract Writer – Book on Psalm 23, Jesus as the Good Shepherd 🔥 3 hours ago GRACE ENTERPRISES, LLC 1 - 10 🏥 Healthcare ⚕️ Healthcare Insurance 🧘 Wellness Website LinkedIn All Job Openings Contract writer developing a manuscript on Psalm 23 for The Daily Grace Co. Focusing on theological depth and the imagery of Jesus as the Good Shepherd. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior ✏️ Content Writer Contract Writer 🔥 3 hours ago GRACE ENTERPRISES, LLC 1 - 10 🏥 Healthcare ⚕️ Healthcare Insurance 🧘 Wellness Website LinkedIn All Job Openings Seeking a contract writer to develop a Christ-centered book for husbands. Focus on theological depth, personal stories, and practical applications to aid husbands in marriage. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior ✏️ Content Writer Contract Writer – Book or Bible Study on Proverbs 31 🔥 15 hours ago GRACE ENTERPRISES, LLC 1 - 10 🏥 Healthcare ⚕️ Healthcare Insurance 🧘 Wellness Website LinkedIn All Job Openings Contract writer developing and writing a Christ-centered book or Bible study on Proverbs 31. Collaborating with the editorial team for theological depth and clarity in the content. 🇺🇸 United States – Remote ⏳ Contract/Temporary 🟡 Mid-level 🟠 Senior ✏️ Content Writer View More Content Writer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Is Remote Rocketship legit? Privacy policy Terms of service Job board SEO course Remote Job Search MasterClass AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs