Adjudicator – Disagreement Resolution, Guideline Governance
Codvo.ai
part-time
Posted on:
Location Type: Remote
Location: India
Visit company websiteExplore more
About the role
- Resolve label disagreements from multi-rater overlap and QA escalations.
- Use side-by-side comparisons, guideline references, and evidence frames/clips to decide final truth.
- Classify disagreement causes (definition ambiguity, visibility limits, procedural variance, annotator error).
- Maintain adjudication logs and update guidelines/decision trees with approved changes.
- Escalate to clinical reviewer when needed; prepare concise packets for decision.
- Ensure adjudicated outputs feed back into training/calibration and pre-label improvement.
Requirements
- 5–10+ years in annotation operations with deep experience in complex labeling tasks.
- Strong judgment and consistency; able to apply guidelines rigorously.
- Excellent written communication; can document rationale cleanly.
- Surgical/clinical familiarity preferred; clinician-in-the-loop experience is a plus.
Benefits
- flexible work arrangements
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
annotation operationslabeling tasksadjudication logsguideline referencesdecision treestraining calibrationpre-label improvement
Soft Skills
judgmentconsistencywritten communicationdocumentation