AI Evaluation SME, Quality Expert
RELX
full-time
Posted on:
Location Type: Office
Location: Netherlands
Visit company websiteExplore more
About the role
- Collaborate with evaluation domain leads to collect and document SME requirements by activity type and timeline.
- Translate evaluation needs into clear SME profiles, sourcing plans, and staffed project specifications.
- Maintain proactive communication with stakeholders to forecast capacity and mitigate risks.
- Implement quality assurance procedures for SME work, including calibration sessions and inter-rater reliability measurement.
- Monitor performance, provide structured feedback, and implement corrective actions where needed.
- Track SME activity completion, invoicing, and payments in partnership with Finance and Procurement.
- Develop quality dashboards and regular reports for stakeholder visibility.
- Maintain SOPs, templates, checklists, and playbooks for project readiness and quality management.
- Drive improvements that increase throughput, reduce cycle time, and improve SME experience.
- Maintain audit-ready, version-controlled documentation and ensure compliance with privacy and procurement policies.
- Build and nurture ongoing relationships with SME communities across specialties and domains.
- Coordinate cross-functional collaboration with HR, Tech, Legal, and Evaluation leads.
- Ensure SMEs receive ongoing support, training updates, and clear communication on SOPs, tools, and rater guidance.
Requirements
- Bachelor's degree in Business Administration, Operations Management, Human Resources, Information Science, Public Health, or related field.
- 3 to 5 years in operations, program management, or quality assurance, ideally in healthcare or research settings.
- Experience with project management platforms and workflow tools.
- Proven ability to produce clear SOPs, training materials, and documentation for technical and non-technical audiences.
- Strong organization and program management across multiple concurrent projects and deadlines.
- Quality management expertise, including calibration facilitation and inter-rater reliability fundamentals.
- Excellent written and verbal communication with strong stakeholder management skills.
- Experience in process improvement and scaling operations; proficiency in Excel or Google Sheets.
- Working knowledge of privacy and compliance in healthcare and research such as HIPAA and GDPR fundamentals.
- Comfortable coordinating with evaluation domain leads and technical teams to drive operational excellence.
Benefits
- Comprehensive Pension Plan
- Home, office, or commuting allowance.
- Generous vacation entitlement and option for sabbatical leave
- Maternity, Paternity, Adoption and Family Care leave
- Flexible working hours
- Personal Choice budget
- Internal communities and networks
- Various employee discounts
- Recruitment introduction reward
- Employee Assistance Program (global)
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
project managementquality assuranceSOP developmentprocess improvementcalibration facilitationinter-rater reliabilityExcelGoogle Sheets
Soft skills
communicationstakeholder managementorganizationprogram management