Review and audit labeled datasets for both text and image-based content to ensure accuracy, consistency, and adherence to guidelines.
Document and share feedback with the individual labelers
Identify trends and insights in quality performance, and effectively mitigate quality performance issues.
Communicate quality trends and insights to the customer. Calibrate with the customer on instructions and edge cases.
Evaluate responses generated by AI, verifying correctness, clarity, relevance, and alignment with task instructions.
Apply knowledge of Consumer Packaged Goods domain to accurately classify and/or describe products.
Collaborate with cross-functional teams to update labeling workflows and improve quality.
Monitor performance metrics (e.g., accuracy rates, inter-rater agreement) and contribute to continuous improvement initiatives.
Generate responses with intentional but realistic grammar, spelling, and structural errors.
calibration sessions to align QA standards across teams and help train new reviewers or analysts.
Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment.
Ensure that documentation is up to date.
Requirements
English as a second language - minimum B2 English proficiency required.
C2 level of Spanish
Ability to follow linguistic and situational writing prompts.
Excellent written communication and coordination skills
2 years working experience in a corporate/ business environment.
Prior experience in at least one of the following:
Linguistic QA
Data annotation for NLP/AI projects
ESL/EFL teaching, editing, or copyediting
Keen eye for detail - spotting subtle grammar and structure issues others miss.
Comfortable reviewing and providing feedback on structured data.
Ability to give actionable and constructive feedback to annotators.
Experience with creating and tracking timelines, milestones, and status reports is a plus.
Access to your own laptop for work.
Benefits
Sama is proud to offer competitive compensation corresponding to market data & level of experience.
health insurance
dental
vision
life insurance
holiday and vacation policies
professional development stipends
paid sabbatical program
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
linguistic QAdata annotationNLPAI projectsgrammarspellingstructured datafeedbackperformance metricsquality assurance
Soft skills
written communicationcoordinationattention to detailconstructive feedbackadaptabilitycollaborationtrend analysisinsight generationproblem-solvingtraining