Filevine

QA Engineer – AI Forms Platform

Filevine

full-time

Posted on:

Location Type: Remote

Location: United States

Visit company website

Explore more

AI Apply
Apply

About the role

  • Design and maintain evaluation harnesses (evals) to measure the accuracy of AI auto-mapping models.
  • Build robust, automated test suites (end-to-end and integration) that run within our CI/CD pipelines.
  • Maintain and expand "golden datasets" of perfectly mapped forms.
  • Collaborate with developers to identify "model quality variance" and implement gates for low-confidence predictions.
  • Verify data integrity during the migration of pilot customers from the legacy platform.
  • Leverage LLMs and AI coding assistants to write test scripts and generate edge-case scenarios.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or related field.
  • 3+ years of experience in QA Automation, with proficiency in tools like Cypress, Selenium, or Playwright.
  • Strong ability to write test scripts in JavaScript, TypeScript, or Python (Java/C++ proficiency also accepted).
  • Experience testing non-deterministic systems (AI/ML models) or complex data migration projects is highly preferred.
  • 1 to 3 years experience working in agile environments with frequent release cycles.
  • Demonstrated ability to use AI tools to solve coding roadblocks and optimize testing workflows.
  • Excellent verbal and written communication skills to articulate quality risks to the product team.
Benefits
  • Medical, Dental, & Vision Insurance (for full-time employees)
  • Competitive & Fair Pay
  • Maternity & paternity leave (for full-time employees)
  • Short & long-term disability
  • Opportunity to learn from a dedicated leadership team
  • Centrally located open office building in Sugar House (onsite employees)
  • Top-of-the-line company swag

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
QA Automationtest scriptsJavaScriptTypeScriptPythonCypressSeleniumPlaywrightAI/ML modelsdata migration
Soft skills
communicationcollaborationproblem-solvingattention to detailanalytical thinking
Certifications
Bachelor’s degree in Computer ScienceBachelor’s degree in Engineering