
QA Engineer – AI Forms Platform
Filevine
full-time
Posted on:
Location Type: Remote
Location: United States
Visit company websiteExplore more
About the role
- Design and maintain evaluation harnesses (evals) to measure the accuracy of AI auto-mapping models.
- Build robust, automated test suites (end-to-end and integration) that run within our CI/CD pipelines.
- Maintain and expand "golden datasets" of perfectly mapped forms.
- Collaborate with developers to identify "model quality variance" and implement gates for low-confidence predictions.
- Verify data integrity during the migration of pilot customers from the legacy platform.
- Leverage LLMs and AI coding assistants to write test scripts and generate edge-case scenarios.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field.
- 3+ years of experience in QA Automation, with proficiency in tools like Cypress, Selenium, or Playwright.
- Strong ability to write test scripts in JavaScript, TypeScript, or Python (Java/C++ proficiency also accepted).
- Experience testing non-deterministic systems (AI/ML models) or complex data migration projects is highly preferred.
- 1 to 3 years experience working in agile environments with frequent release cycles.
- Demonstrated ability to use AI tools to solve coding roadblocks and optimize testing workflows.
- Excellent verbal and written communication skills to articulate quality risks to the product team.
Benefits
- Medical, Dental, & Vision Insurance (for full-time employees)
- Competitive & Fair Pay
- Maternity & paternity leave (for full-time employees)
- Short & long-term disability
- Opportunity to learn from a dedicated leadership team
- Centrally located open office building in Sugar House (onsite employees)
- Top-of-the-line company swag
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
QA Automationtest scriptsJavaScriptTypeScriptPythonCypressSeleniumPlaywrightAI/ML modelsdata migration
Soft skills
communicationcollaborationproblem-solvingattention to detailanalytical thinking
Certifications
Bachelor’s degree in Computer ScienceBachelor’s degree in Engineering