Sama

Project Manager

• Review and audit labeled datasets for both text and image-based content to ensure accuracy, consistency, and adherence to guidelines
• Document and share feedback with the individual labelers
• Identify trends and insights in quality performance and mitigate quality performance issues
• Communicate quality trends and insights to the customer and calibrate with the customer on instructions and edge cases
• Evaluate responses generated by AI for correctness, clarity, relevance, and alignment with task instructions
• Apply knowledge of Consumer Packaged Goods domain to accurately classify and/or describe products
• Collaborate with cross-functional teams to update labeling workflows and improve quality
• Monitor performance metrics (e.g., accuracy rates, inter-rater agreement) and contribute to continuous improvement initiatives
• Generate responses with intentional but realistic grammar, spelling, and structural errors
• Run calibration sessions to align QA standards across teams and help train new reviewers or analysts
• Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment
• Ensure that documentation is up to date

Quality Analyst / Project Coordinator, Japanese Speaker