# Model Inference Engineer

**Company**: Thomson Reuters
**Location**: Zug, Zug
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://thomsonreuters.wd5.myworkdayjobs.com/en-US/External_Career_Site/job/Switzerland-Zug-Zug/Lead-Senior-Engineer--Model-Inference_JREQ205582?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/model-inference-engineer-3619e432-bbc/

## Description

Thomson Reuters Labs is the global research and development division of Thomson Reuters. We bring together scientists, engineers, and domain experts to explore emerging technologies and develop state-of-the-art AI products.

You'll work hands-on building and operating Mariner, Thomson Reuters' custom inference platform. Mariner serves every production call to the Thomson model family, plus the frontier models we benchmark against, and is scaling to new product integrations and business lines.

**Key Responsibilities**

- Build and operate the model-serving infrastructure that runs Thomson's production traffic.

- Implement and tune inference-optimization techniques to reduce cost and latency without sacrificing quality.

- Improve Mariner's observability as call volume and the deployment surface grow.

- Build out Thomson's production footing: implement the controls and evidence for the ISO 27001 compliance path, the cost-tracking and attribution Finance relies on, and GPU-capacity contingency plans.

- Make and document cost vs. latency vs. reliability tradeoffs, and bring them to the Director and partner teams.

- Work directly with the training and evaluation pods to get new model releases live on the serving stack.

- Help stand up the team's own practices and tooling.

- Collaborate with research and product stakeholders and engineering leadership.

**Required Qualifications**

- Hands-on infrastructure engineering experience with Kubernetes or similar.

- Experience keeping model services up across multiple use cases.

- Direct experience with model-serving infrastructure and/or inference optimization for large models.

- Large-scale distributed systems experience.

- Comfort debugging distributed systems and production incidents.

- A track record of shipping software end to end.

- Champion and enforce engineering best practices.

- Ability to operate autonomously as an early lead engineer.

**Preferred Qualifications**

- Experience with common LLM-serving stacks.

- Exposure to GPU-cluster capacity planning or multi-region/multi-cloud deployment.

- Exposure to a regulated or compliance-heavy production environment.

- Familiarity with systems development languages.

- Comfort with systems-level optimization.

**What's in it For You?**

- Hybrid Work Model

- Flexibility & Work-Life Balance

- Career Development and Growth

- Industry Competitive Benefits

- Culture

- Social Impact

- Making a Real-World Impact

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Kubernetes
- model-serving infrastructure
- inference optimization
- large-scale distributed systems
- debugging

### Nice to have
- LLM-serving stacks
- GPU-cluster capacity planning
- multi-region/multi-cloud deployment
- systems development languages
- systems-level optimization

---

Source: [Apply at thomsonreuters.wd5.myworkdayjobs.com](https://thomsonreuters.wd5.myworkdayjobs.com/en-US/External_Career_Site/job/Switzerland-Zug-Zug/Lead-Senior-Engineer--Model-Inference_JREQ205582?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)
