Define success criteria for AI-driven features where no industry standards exist, and clarify what “correct” truly means.
Design and execute testing strategies for AI tools, including exploratory and adversarial testing to uncover failure modes.
Develop evaluation frameworks to measure AI behavior - accuracy, consistency, hallucination rate, edge-case handling, and stability.
Build and maintain testing datasets, validation pipelines, and experimentation frameworks.
Identify patterns in AI behavior, developing intuition around its strengths, weaknesses, and risk areas.
Act as the voice of quality strategy, bridging the gap between what we build and how we know it’s truly good.

Requirements

4+ years of experience in software quality engineering (experience with AI-powered products is a strong plus).
Strong critical thinking - you reason from first principles, not templates.
Experience in web testing and automation (Playwright, Cypress, Selenium, or similar), and confidence working with APIs, logs, debugging tools, and data.
Ability to define and measure quality beyond “it works,” including meaningful metrics and evaluation criteria.
Strong interest in how AI systems work under the hood, with the curiosity to quickly learn new tools and technologies.
Comfortable operating in ambiguity - no documentation, no prior art, no one to ask.
Proactive, analytical, and persistent, with strong communication skills in English (Lithuanian is a plus).

Benefits

**🚀 360 Growth:** We provide limitless learning opportunities: access to platforms like Reforge and CoachHub, global conferences, physical and digital libraries, feedback culture, and mentoring through TesoXchange. Advance your career with internal mobility and grow with a team eager to share knowledge and support your success.
**🎯 Freedom & responsibility:** Work on your terms: from modern offices in Kaunas and Vilnius, the comfort of home, or anywhere in the world. Enjoy flexibility in managing your schedule and bring your ideas to life in a fast-paced, dynamic environment.
**💪Wellness simplified:** Your health comes first with insurance from Day 1, gym memberships, recharge leave, Headspace subscriptions, and regular health checks. Join our wellbeing-dedicated events, sports, arts, and hobby clubs, or simply enjoy the balance of a lifestyle that prioritizes wellness.
**🎉 Work hard – play hard:** Celebrate your achievements with company events like Summerfest & Winterfest, Town Hall, Meet the Client initiatives, team-buildings, and workations. Enjoy access to the Žalgiris Arena VIP Lounge and celebrate life’s big moments with milestone gifts for weddings, new parenthood, and graduations.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

software quality engineeringAI-driven featurestesting strategiesexploratory testingadversarial testingevaluation frameworkstesting datasetsvalidation pipelinesautomation testingAPI testing

Soft Skills

critical thinkinganalytical skillsproactivecommunication skillscuriosityability to operate in ambiguitypersistence