Sully.ai

QA Automation Engineer

Sully.ai

contract

Posted on:

Origin:  • 🇺🇸 United States

Visit company website
✨ AI Apply
Manual Apply

Salary

💰 $115,000 - $140,000 per year

Job Level

Mid-LevelSenior

Tech Stack

Grafana

About the role

  • About Sully.ai: Sully.ai is transforming healthcare access by integrating AI into medical workflows and automating healthcare administrative tasks throughout the patient visit cycle - enhancing efficiency, reducing errors, and supporting real-time decision-making.\n
  • What You'll Do: Translate existing manual/Excel test cases into automated Playwright + API test scripts; Maintain test frameworks and keep automation stable as the codebase evolves; Integrate tests into GitHub Actions pipelines with reporting and alerts; Investigate failures, fix flaky tests, and improve test resilience; Build dashboards to visualize test coverage, pass/fail trends, and defect patterns for the team; Collaborate with product, design, and engineering to align test coverage with release priorities.\n
  • What You'll Bring: Playwright expertise for UI/E2E automation; API test automation (Postman/Newman, REST Assured, supertest, or pytest); Excel-based test cases → able to read, interpret, and convert them into automated tests; GitHub Actions (GHA) experience for running tests in CI/CD, including parallelization and artifacts; Dashboarding & reporting (Allure, ReportPortal, Grafana, Power BI, or similar) for sharing results with the broader team; Strong break/fix skills-can investigate, diagnose, and stabilize failing or flaky tests; Comfortable with scaling test suites.\n
  • Why Join: Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.

Requirements

  • Playwright expertise for UI/E2E automation.\n
  • API test automation (Postman/Newman, REST Assured, supertest, or pytest).\n
  • Excel-based test cases → able to read, interpret, and convert them into automated tests.\n
  • GitHub Actions (GHA) experience for running tests in CI/CD, including parallelization and artifacts.\n
  • Dashboarding & reporting (Allure, ReportPortal, Grafana, Power BI, or similar) for sharing results with the broader team.\n
  • Strong break/fix skills-can investigate, diagnose, and stabilize failing or flaky tests.\n
  • Comfortable with scaling test suites.