Artemis Connection

General

• Design and develop test items, scales, and assessment instruments aligned with defined constructs and learning/behavioral objectives
• Conduct item analysis, reliability testing, and validity studies (content, construct, criterion)
• Apply Classical Test Theory (CTT) and/or Item Response Theory (IRT) models to evaluate and refine test items
• Perform equating, standard setting, and scaling to ensure comparability across test forms and administrations
• Conduct differential item functioning (DIF) analysis to identify and address potential bias across demographic groups
• Partner with subject matter experts to build and review item banks
• Analyze assessment data and produce technical reports summarizing psychometric properties, score interpretations, and recommendations
• Ensure assessments comply with relevant professional standards (e.g., APA/AERA/NCME Standards for Educational and Psychological Testing) and legal/regulatory requirements
• Compile and organize psychometric evidence, technical documentation, and validity/reliability reports needed to support the re-accreditation self-study and site visit
• Serve as the assessment subject-matter expert in preparing responses to accreditor inquiries and addressing any prior findings or areas of concern
• Support the design of pilot studies and field tests for new or revised instruments
• Collaborate with academic leadership, product, research, and data teams to translate psychometric findings into actionable improvements

Psychometrician