Senior Quality Engineer – Chatbot

Mimica

Quality Engineer defining testing and release practices for Mimica’s AI-powered task-mining platform and conversational Chatbot. Evaluating dynamic LLM outputs, improving guardrails, and enabling reliable software delivery.

Posted 8/4/2026full-timeRemote • 🇬🇧 United KingdomSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in software quality engineering with a focus on testing dynamic and non-deterministic systems, particularly in the context of Chatbot and LLM technologies. Proficient in establishing quality practices, collaborating with engineering teams, and implementing innovative testing strategies.

Highest-signal resume keywords

Software Quality EngineeringTest AutomationChatbot TestingProgramming ProficiencyAI Security Testing

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Test Strategy DevelopmentOutput-Evaluation FrameworkPerformance TestingCode ReviewExperimental Mindset

Soft Skills

Clear CommunicationCollaboration SkillsPragmatic ApproachGood Judgement

Tools & Technologies

LLM-Powered SystemsConversational AITesting Tools

Industry Keywords

AI-Specific RisksPrompt InjectionQuality SignalsRelease ReadinessGuardrails

About the role

Key responsibilities & impact

Develop and evolve quality practices, test strategy, and release processes for the Chatbot product
Establish and run an output-evaluation framework for assessing Chatbot quality, reliability, and regressions
Test dynamic and non-deterministic LLM-based systems beyond conventional deterministic test cases
Identify, test, and improve guardrails for AI-specific risks, including prompt injection and unsafe or unexpected model behaviour
Partner with engineers through code reviews, technical discussions, and collaborative debugging
Investigate testing gaps, research relevant methods and tools, and make evidence-based recommendations
Design proof-of-concepts for new testing approaches or tooling and help productionise valuable solutions
Support release testing, quality signals, and release-readiness criteria
Contribute performance-testing practices for LLM-powered workflows
Share knowledge, facilitate technical discussions, and build the Quality Chapter across engineering

Requirements

What you’ll need

Strong hands-on experience in software quality engineering, SDET, test automation, or a closely related engineering role
Experience testing chatbot, conversational AI, RAG, LLM-powered, or other dynamic and non-deterministic systems
Proficiency in at least one programming language
Technical depth to understand production code, contribute to code reviews, and collaborate with software engineers
Experimental and investigative mindset for exploring uncertain problem spaces and turning findings into practical improvements
Clear written and verbal communication
Strong collaboration skills and pragmatic approach with Product, Engineering, and ML colleagues
Good judgement in prioritising quality work based on risk, user impact, and delivery goals
Bonus: experience with AI security and safety testing
Bonus: experience testing conversational AI, chatbot platforms, or agentic workflows
Bonus: experience as the first Quality Engineer in a team
Bonus: experience mentoring engineers or influencing testing practices across a cross-functional team
Keeps pace with industry developments and fosters knowledge sharing

Benefits

Comp & perks

Generous compensation
Stock options
Fully remote work, with the option to work in company hubs or a mix
Company-issued laptop
Remote setup stipend
Co-working budget
Flexible schedules and location
Ample paid time off, in addition to local public holidays
Enhanced parental leave
Health and retirement benefits
Annual learning & development budget
Annual workaways
Regular virtual and in-person socials
Opportunity to contribute to groundbreaking projects that shape the future of work