FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Portuguese Audio Evaluations Specialist – Freelance AI Trainer
Invisible TechnologiesSourcing independent Audio Evaluation Specialists for AI benchmarking project assessing audio models. Design evaluation frameworks and contribute to high-quality audio datasets.
About the role
Key responsibilities & impact- Operate autonomously to design complex evaluation frameworks and provide structured training data.
- Role-Play Scenario Execution: Creating and executing complex, role-play-based evaluation scenarios that simulate realistic customer service interactions across travel, finance, and technical support domains.
- Model Performance Auditing: Evaluating AI model performance across standardized qualitative and quantitative metrics, focusing strictly on task completion accuracy, conversational naturalness, and audio comprehension.
- Technical Metric Evaluation: Assessing the model's basic computer programming literacy, including its understanding of JSON structures, functions, methods, and ability to reason about structured data within a support context.
- Representative Dataset Generation: Contributing to the development of diverse, high-quality audio datasets that accurately reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Requirements
What you’ll need- Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
- Native or bilingual proficiency in the target language, including fluency across all language skills (reading, listening, writing, and speaking), alongside strong analytical and verbal communication skills to confidently conduct simulated customer support role-plays.
- Basic computer programming literacy, specifically a comfortable understanding of JSON structures, functions, methods, and simple logic.
- A meticulous, detail-oriented approach to working with structured prompts, complex evaluation rubrics, and technical guidelines.
- Access to a high-quality microphone to ensure clean, reliable audio input during voice evaluations.
Benefits
Comp & perks- Health insurance and PTO do not apply
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
JSON structuresfunctionsmethodstechnical troubleshootingconversational AI evaluationevaluation frameworksmodel performance auditingtechnical metric evaluationdataset generationcustomer service interactions
Soft Skills
analytical skillsverbal communicationdetail-orientedautonomous operationstrong communication skills