People Scientist
MakiPeople
full-time
Posted on:
Location Type: Hybrid
Location: Paris • 🇫🇷 France
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
BigQueryCloudPython
About the role
- Selection & Evaluation of AI & Psychometric Models - Assess the statistical accuracy and reliability of LLMs used for automated scoring.
- Human-AI Comparison & Hybrid Evaluation Models - Design research comparing AI-scored assessments with expert human judgments to ensure validity and alignment.
- Bias & Fairness Analysis - Detect and analyse potential biases in AI-generated or psychometric scores across demographic groups.
- Predictive Analytics & Performance Insights - Work with large-scale assessment and performance datasets to model relationships between candidate scores, job performance, and retention outcomes.
- Ongoing Model Monitoring & Issue Resolution - Investigate anomalies raised by clients or internal QA.
- Technical Research Combining AI & Psychometrics - Explore fine-tuning, prompt-engineering, and evaluation methods to enhance model performance.
Requirements
- Advanced degree (PhD/MSc) in Data Science, Machine Learning, Psychometrics, Computational Linguistics, or Psychology.
- Proven expertise in AI model evaluation, psychometric validation, and statistical analysis.
- Basic knowledge of psychometric modelling (e.g., IRT, CFA, CAT) and its application in assessment design and validation.
- Familiarity with LLMs and NLP techniques used for automated assessment and scoring.
- Experience applying fairness and bias testing methodologies in AI-driven decisions.
- Skilled in validation research ensuring reliability, construct validity, and practical relevance of assessments.
- Proficiency in Python or R and experience with statistical software (e.g., SPSS, Mplus, JASP) and cloud databases (e.g., BigQuery).
- Strong grounding in ethical AI, data governance, and compliance.
- Experienced in collaborating across teams (engineering, product, content) and communicating insights clearly to both scientific and business audiences.
- Skilled in data visualisation and research writing, with a track record of publications or applied studies.
Benefits
- N/A 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
AI model evaluationpsychometric validationstatistical analysispsychometric modellingIRTCFACATNLP techniquesdata visualisationresearch writing
Soft skills
collaborationcommunicationproblem-solvingcritical thinkingethical AI understanding
Certifications
PhDMSc