FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Psychometrician
Artemis ConnectionPsychometrician leading the design and analysis of assessments for an education company. Ensuring compliance with accreditation standards and producing technical documentation for evaluations.
Posted 7/14/2026full-timeSeattle • Washington • 🇺🇸 United StatesMid-LevelSenior💰 $90,000 - $120,000 per yearWebsite
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in psychometric analysis, including Classical Test Theory and Item Response Theory, while ensuring compliance with professional standards and producing actionable insights from assessment data. Proficient in statistical software and psychometric tools to support the development and evaluation of assessment instruments.
Highest-signal resume keywords
Classical Test Theory (CTT)Item Response Theory (IRT)Statistical Software Proficiency (R, SPSS, SAS, Python)Differential Item Functioning (DIF) AnalysisAssessment Compliance Standards (APA/AERA/NCME)
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Test Item DesignReliability TestingValidity StudiesEquating and Standard SettingData AnalysisTechnical Report WritingComputerized Adaptive Testing (CAT)Automated Test AssemblyFairness and Bias DetectionLarge-Scale Assessment Data Analysis
Soft Skills
Excellent Written CommunicationCollaboration with Subject Matter ExpertsPresentation Skills
Tools & Technologies
BILOGWinstepsFlexMIRTJMetrik
Industry Keywords
PsychometricsEducational MeasurementQuantitative PsychologyAccreditation Self-StudyCredentialing and Certification
Tech Stack
Tools & technologiesAssemblyPython
About the role
Key responsibilities & impact- Design and develop test items, scales, and assessment instruments aligned with defined constructs and learning/behavioral objectives
- Conduct item analysis, reliability testing, and validity studies (content, construct, criterion)
- Apply Classical Test Theory (CTT) and/or Item Response Theory (IRT) models to evaluate and refine test items
- Perform equating, standard setting, and scaling to ensure comparability across test forms and administrations
- Conduct differential item functioning (DIF) analysis to identify and address potential bias across demographic groups
- Partner with subject matter experts to build and review item banks
- Analyze assessment data and produce technical reports summarizing psychometric properties, score interpretations, and recommendations
- Ensure assessments comply with relevant professional standards (e.g., APA/AERA/NCME Standards for Educational and Psychological Testing) and legal/regulatory requirements
- Compile and organize psychometric evidence, technical documentation, and validity/reliability reports needed to support the re-accreditation self-study and site visit
- Serve as the assessment subject-matter expert in preparing responses to accreditor inquiries and addressing any prior findings or areas of concern
- Support the design of pilot studies and field tests for new or revised instruments
- Collaborate with academic leadership, product, research, and data teams to translate psychometric findings into actionable improvements
Requirements
What you’ll need- Master's or Ph.D. in Psychometrics, Educational Measurement, Quantitative Psychology, Statistics, or a related field
- Strong foundation in CTT, IRT, and test validity/reliability frameworks
- Proficiency with statistical software (e.g., R, SPSS, SAS, Python) and psychometric-specific tools (e.g., BILOG, Winsteps, flexMIRT, jMetrik)
- Experience analyzing large-scale assessment data sets
- Excellent written communication skills for producing technical reports for both technical and non-technical audiences.
- Experience with computerized adaptive testing (CAT) or automated test assembly (preferred)
- Familiarity with fairness and bias detection methodologies (e.g., DIF, disparate impact analysis) (preferred)
- Background in credentialing, certification, educational, or workforce assessment contexts (preferred)
- Prior experience supporting an accreditation self-study, site visit, or accreditor response process (preferred)
- Experience presenting findings to stakeholders, academic leadership, or accreditation committees (preferred)
Benefits
Comp & perks- 🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Artemis Connection Website LinkedIn All Job Openings 51 - 200 employees Founded 2015 🤝 B2B 🤝 Non-profit Consulting
- B2B
- Non-profit Artemis Connection is a strategic consulting firm that helps clients achieve significant goals through effective strategies and organizational development. Since its inception in 2015, the firm has partnered with a diverse range of clients, from large publicly traded companies to nonprofits, focusing on creating lasting change. With a client-centric model, Artemis is committed to simplifying processes and providing tailored solutions that drive success and impact. Psychometrician Job not on LinkedIn 🔥 3 minutes ago 🏢 Seattle – Onsite 💵 $90k - $120k / year ⏰ Full Time 🟡 Mid-level 🟠 Senior Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
- Design and develop test items, scales, and assessment instruments aligned with defined constructs and learning/behavioral objectives
- Conduct item analysis, reliability testing, and validity studies (content, construct, criterion)
- Apply Classical Test Theory (CTT) and/or Item Response Theory (IRT) models to evaluate and refine test items
- Perform equating, standard setting, and scaling to ensure comparability across test forms and administrations
- Conduct differential item functioning (DIF) analysis to identify and address potential bias across demographic groups
- Partner with subject matter experts to build and review item banks
- Analyze assessment data and produce technical reports summarizing psychometric properties, score interpretations, and recommendations
- Ensure assessments comply with relevant professional standards (e.g., APA/AERA/NCME Standards for Educational and Psychological Testing) and legal/regulatory requirements
- Compile and organize psychometric evidence, technical documentation, and validity/reliability reports needed to support the re-accreditation self-study and site visit
- Serve as the assessment subject-matter expert in preparing responses to accreditor inquiries and addressing any prior findings or areas of concern
- Support the design of pilot studies and field tests for new or revised instruments
- Collaborate with academic leadership, product, research, and data teams to translate psychometric findings into actionable improvements 🎯 Requirements
- Master's or Ph.D. in Psychometrics, Educational Measurement, Quantitative Psychology, Statistics, or a related field
- Strong foundation in CTT, IRT, and test validity/reliability frameworks
- Proficiency with statistical software (e.g., R, SPSS, SAS, Python) and psychometric-specific tools (e.g., BILOG, Winsteps, flexMIRT, jMetrik)
- Experience analyzing large-scale assessment data sets
- Excellent written communication skills for producing technical reports for both technical and non-technical audiences.
- Experience with computerized adaptive testing (CAT) or automated test assembly (preferred)
- Familiarity with fairness and bias detection methodologies (e.g., DIF, disparate impact analysis) (preferred)
- Background in credentialing, certification, educational, or workforce assessment contexts (preferred)
- Prior experience supporting an accreditation self-study, site visit, or accreditor response process (preferred)
- Experience presenting findings to stakeholders, academic leadership, or accreditation committees (preferred) Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Avionics Systems Integrator II 🕒 Yesterday BLUE ORIGIN 10,000+ employees Website LinkedIn All Job Openings Avionics Systems Integrator II supporting the development and operation of New Glenn, a reusable heavy-lift orbital launch vehicle. Collaborating on avionics integration and operational constraints for flight success. 🏢 Seattle – Onsite 💵 $99.2k - $138.9k / year 💰 Grant on 2021-12 ⏰ Full Time 🟡 Mid-level 🟠 Senior 🦅 H1B Visa Sponsor Surgical Device Specialist, Ophthalmology 🕒 4 days ago Roche 10,000+ employees 💊 Pharmaceuticals 🧬 Biotechnology 🔬 Science Website LinkedIn All Job Openings Surgical Device Specialist driving clinical demand and training for Ophthalmology Vision at Genentech. Collaborating with healthcare providers on introducing surgical devices. 🏢 Seattle – Onsite 💵 $96.3k - $178.8k / year 💰 $5G Post IPO equity on 2021-09 ⏰ Full Time 🟡 Mid-level 🟠 Senior 🦅 H1B Visa Sponsor Business Service Officer 🕒 5 days ago Ms Ms 5001 - 10000 📱 Media 👥 B2C Website LinkedIn All Job Openings Business Service Officer at Morgan Stanley supervising support teams and improving client experience. Leading operational initiatives and ensuring compliance with firm policies and procedures. 🏢 Seattle – Onsite 💵 $120k - $165k / year ⏰ Full Time 🟡 Mid-level 🟠 Senior Fiscal Specialist 2 🕒 July 3 Uw - 📚 Education 🔬 Science 🤝 Non-profit Website LinkedIn All Job Openings Fiscal Specialist managing payroll, travel reimbursement, purchasing, and financial planning functions in diverse units at the University of Washington. Collaborative role with focus on technical fiscal analysis and financial reporting. 🏢 Seattle – Onsite 💵 $53.1k - $71.4k / year ⏰ Full Time 🟡 Mid-level 🟠 Senior 🦅 H1B Visa Sponsor Knowledge Management Specialist 🕒 July 1 Lynker 501 - 1000 🔬 Science Website LinkedIn All Job Openings Knowledge Management Specialist enhancing organizational knowledge and collaboration in environmental science. Coordinating Google Drive modernization and supporting information management initiatives at NOAA. 🏢 Seattle – Onsite 💵 $70k - $95k / year ⏰ Full Time 🟡 Mid-level 🟠 Senior 🦅 H1B Visa Sponsor 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs