Product Marketing Manager, Technical Marketing
Dataiku
Quality Specialist – AI Trainer
Invisible Technologies
contract
Posted on:
Origin: • 🌎 Anywhere in the World
Visit company websiteSalary
💰 $8 - $65 per hour
Job Level
Mid-LevelSenior
About the role
- Evaluate AI-generated outputs for accuracy, consistency, and compliance with guidelines
- Review and audit AI-generated outputs and conduct spot checks across diverse datasets
- Flag errors and inconsistencies and document reproducible failure points
- Apply QA best practices to assess data quality and identify systematic issues
- Provide actionable feedback to improve processes and model outcomes
- Collaborate closely with training and evaluation teams to refine quality standards, enhance guidelines, and strengthen model evaluation metrics
- Help refine evaluation metrics and support continuous improvement of AI training pipelines
Requirements
- Prior experience in AI training or evaluation (required)
- Hands-on experience in AI training and evaluation workflows
- Solid understanding of QA methodologies
- Strong analytical skills
- Attention to detail
- Ability to clearly communicate findings
- Familiarity with annotation platforms, workflow management, or linguistic/technical evaluation (strong plus)
- Must supply a secure computer and reliable internet connection (contractor requirement)
- Mid-Senior level experience
