Description
The Corporate Engineering AI team is the central enablement and platform delivery function for LSEG's internal agentic AI ecosystem.
The team's mission is to scale safe, high-quality AI capabilities across the enterprise by providing shared platforms, patterns, governance, and delivery support.
The Quality Engineers will be responsible for:
- Defining and implementing evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact.
- Building and maintaining automated test pipelines for agentic behaviours, including tool invocation and multi-step workflows.
- Evaluating and mitigating agentic failure modes such as hallucination, tool misuse, invalid inputs, and latency amplification.
- Producing testing evidence required for Permit to Build (PTB) and Permit to Operate (PTO).
- Partnering with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills.
- Helping define the long-term quality and governance model for federated MCP contributions across LSEG.
The ideal candidate will have:
- Strong Python experience for test harnesses and automation.
- Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines.
- Test automation expertise covering unit, integration, and regression testing.
- Understanding of agentic system risks and failure modes.
- Ability to assess solutions against governance, security, and audit expectations.
- Experience working in regulated or highly governed engineering environments.
LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days, and wellbeing initiatives.