Review and audit labeled datasets for text and image-based content to ensure accuracy, consistency, and adherence to guidelines.
Document and share feedback with individual labelers; provide actionable and constructive feedback.
Identify trends and insights in quality performance and mitigate quality issues.
Communicate quality trends and calibrate with the customer on instructions and edge cases.
Evaluate AI-generated responses for correctness, clarity, relevance, and alignment with task instructions.
Apply Consumer Packaged Goods domain knowledge to classify and describe products.
Collaborate with cross-functional teams to update labeling workflows and improve quality.
Monitor performance metrics (e.g., accuracy rates, inter-rater agreement) and contribute to continuous improvement.
Generate responses with intentional but realistic grammar, spelling, and structural errors as required.
Run calibration sessions to align QA standards and help train new reviewers or analysts.
Adapt quickly to evolving guidelines, new task types, and AI model updates; ensure documentation is up to date.
Requirements
English as a second language - minimum C1 English proficiency required.
C2 level of French.
Ability to follow linguistic and situational writing prompts.
Excellent written communication and coordination skills.
2 years working experience in a corporate/business environment.
Prior experience in at least one of: Linguistic QA; Data annotation for NLP/AI projects; ESL/EFL teaching, editing, or copyediting.
Keen eye for detail - spotting subtle grammar and structure issues others miss.
Comfortable reviewing and providing feedback on structured data.
Ability to give actionable and constructive feedback to annotators.
Experience with creating and tracking timelines, milestones, and status reports is a plus.
Preferred: C1 or C2 level English proficiency, familiarity with error tagging systems, experience in CPG industry/workflows or relevant retail product knowledge.