Cresta

Quality Assurance Analyst – AI Delivery

Cresta

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $50,000 - $70,000 per year

Job Level

Junior

About the role

  • Review AI-generated summaries for accuracy and completeness; provide feedback to improve models.
  • Conduct behavioral audits to verify agent triggers and responses match expected outcomes.
  • Perform redaction audits to protect sensitive customer data.
  • Run bias audits to detect and document fairness issues.
  • Compare audio and text for transcription accuracy.
  • Support Opera platform maintenance and rule configuration to keep AI outputs accurate.

Requirements

  • 1–3 years in QA or data labeling
  • Exceptional attention to detail and analytical rigor
  • Strong documentation and communication skills
  • Comfort with accuracy-driven tasks
  • Familiarity with conversational AI or annotation tools (preferred)
  • Experience with bias / redaction audits or speech-to-text QA (preferred)
Benefits
  • Competitive pay and equity
  • Medical, dental, vision coverage
  • Flexible PTO, remote-first culture
  • Monthly wellness stipend & home-office support

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
QAdata labelingbehavioral auditsredaction auditsbias auditstranscription accuracydocumentationanalytical rigor
Soft skills
attention to detailcommunication skillsaccuracy-driven tasks
Assured

Staff QA Engineer

Assured
Leadfull-time$150k–$170k / year🇺🇸 United States
Posted: 1 hour agoSource: jobs.ashbyhq.com
CypressJavaScriptPythonSDLCSeleniumTypeScript
Gravie

Senior Quality Assurance Nurse Manager

Gravie
Seniorfull-time$96k–$160k / year🇺🇸 United States
Posted: 3 hours agoSource: jobs.lever.co
ExamWorks

Clinical Quality Assurance Coordinator

ExamWorks
Junior · Midfull-time$26–$28Illinois · 🇺🇸 United States
Posted: 5 hours agoSource: www.paycomonline.net
ExamWorks

Clinical Quality Assurance Coordinator

ExamWorks
Junior · Midfull-time$26–$28Illinois · 🇺🇸 United States
Posted: 5 hours agoSource: www.paycomonline.net
NFPA

Software QA Engineer

NFPA
Mid · Seniorfull-timeMassachusetts · 🇺🇸 United States
Posted: 6 hours agoSource: recruiting.paylocity.com
AngularCypressJavaScriptjQueryReactSeleniumSQL