Director, Free Response Rating Capability Analyst

The College Board

Director of FR Rating Capability Analyst enhancing AP Reading scoring operations through analytics and operational improvements. Collaborating across teams to scale digital scoring capabilities for the future.

Posted 5/19/2026full-timeRemote • 🇺🇸 United StatesLead💰 $80,000 - $130,000 per yearWebsite

Tech Stack

Tools & technologies

SQL

About the role

Key responsibilities & impact

Define and maintain the capability roadmap for FR rating operations, including tools, workflows, reporting structures, and performance measurement systems that support high-quality scoring at scale.
Translate operational needs and scoring insights into clearly defined business requirements, system enhancements, reporting frameworks, and process improvements.
Partner with Technology and Product teams to design, test, and implement enhancements to scoring platforms and data pipelines.
Develop scalable frameworks for evaluating scoring effectiveness, including consistency, accuracy, throughput, and reader-level performance metrics.
Support the end-to-end AP Exam scoring workflow, including reader training, scoring operations, psychometric data collection, and operational reporting.
Monitor scoring performance signals during live AP Reading and enable rapid operational interventions through data-driven insights.
Develop analytic models, dashboards, and reporting tools that provide real-time and post-Reading insights into scoring performance.
Establish standardized reporting and postmortem analysis processes that support continuous improvement across Reading cycles.
Create and maintain cross-functional RACI documentation related to digital scoring platform deployment, configuration, and operational support.

Requirements

What you’ll need

Expertise in operational analytics, scoring operations, education systems, or related fields with experience supporting large-scale operational environments.
Strong analytical and systems-thinking skills, with demonstrated ability to translate data into operational improvements and scalable solutions.
Experience working with large-scale datasets and reporting tools such as Excel, SQL, BI tools, or similar technologies.
Strong project management and prioritization skills with the ability to manage competing priorities across multiple stakeholders.
Excellent written and verbal communication skills, including the ability to simplify complex analyses into actionable insights.
Experience collaborating across cross-functional teams including operations, technology, product, analytics, and research partners.
Comfort operating in both strategic planning and hands-on execution environments.
Experience in assessment, scoring operations, educational measurement, or education data systems strongly preferred.
Bachelor’s degree required; advanced degree preferred.
Ability to travel 2–4 times per year to College Board offices or on behalf of College Board business.

Benefits

Comp & perks

Annual bonuses and opportunities for merit-based raises and promotions
A mission-driven workplace where your impact matters
A team that invests in your development and success

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

operational analyticsscoring operationsdata pipelinesanalytic modelsreporting frameworksperformance measurement systemslarge-scale datasetsExcelSQLBI tools

Soft Skills

analytical skillssystems-thinkingproject managementprioritizationwritten communicationverbal communicationcollaborationstrategic planninghands-on executionability to simplify complex analyses