Machine Learning Quality Engineer

LSEG (London Stock Exchange Group)

Quality Engineer defining evaluation frameworks for agentic AI capabilities at LSEG. Building automated test pipelines and collaborating with ML Engineers to ensure quality and governance.

Posted 7/14/2026full-timeLondon • 🇬🇧 United KingdomJuniorMid-LevelWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Python for test automation and evaluation frameworks, with a strong focus on agentic system risks and compliance in regulated environments. Capable of building automated test pipelines and producing necessary testing evidence for governance and operational permits.

Highest-signal resume keywords

Python ProgrammingTest Automation ExpertiseLLM Evaluation FrameworksAgentic System Risk AssessmentRegulated Engineering Experience

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Test Harness DevelopmentUnit TestingIntegration TestingRegression TestingAutomated Test Pipelines

Tools & Technologies

MCP ToolsEvaluation Frameworks

Industry Keywords

Permit to BuildPermit to OperateGovernanceSecurityAudit Expectations

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Define and implement evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact
Build and maintain automated test pipelines for agentic behaviours, including tool invocation and multi‑step workflows
Evaluate and mitigate agentic failure modes such as hallucination, tool misuse, invalid inputs, and latency amplification
Produce testing evidence required for Permit to Build (PTB) and Permit to Operate (PTO)
Partner with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills
Help define the long‑term quality and governance model for federated MCP contributions across LSEG

Requirements

What you’ll need

Strong Python experience for test harnesses and automation
Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines
Test automation expertise covering unit, integration, and regression testing
Understanding of agentic system risks and failure modes
Ability to assess solutions against governance, security, and audit expectations
Experience working in regulated or highly governed engineering environments

Benefits

Comp & perks

Healthcare
Retirement planning
Paid volunteering days
Wellbeing initiatives