Italian-Speaking AI Evaluation Specialist

BPCS, Comprehensive marketing solutions, ltd.

AI Evaluation Specialist testing and evaluating AI-generated responses in Italian at Blueprint Technologies. Ensuring outputs are accurate, relevant, and culturally appropriate.

Posted 4/20/2026full-timeRemote • Washington • 🇺🇸 United StatesMid-LevelSenior💰 $30 - $35 per hourWebsite

About the role

Key responsibilities & impact

Evaluate and compare AI-generated responses in Italian
Perform side-by-side analysis of outputs from different AI systems
Assess responses for accuracy, relevance, clarity, and instruction-following
Identify nuances in meaning, tone, and cultural context
Apply structured annotation guidelines consistently
Work with datasets of real user queries

Requirements

What you’ll need

Native or professional fluency in Italian
Strong English reading comprehension
Analytical thinking and attention to detail
Experience with structured evaluation or guidelines
Background in linguistics, translation, or localization (preferred)
Experience with data annotation, AI evaluation, or search relevance (preferred)

Benefits

Comp & perks

Medical, dental, and vision coverage
Flexible Spending Account
401k program
Competitive PTO offerings
Parental Leave
Opportunities for professional growth and development

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data annotationAI evaluationsearch relevancelinguisticstranslationlocalization

Soft Skills

analytical thinkingattention to detailstrong English reading comprehension