# Site Reliability Engineer, Provider Operations

**Company**: OpenRouter
**Location**: Remote (US)
**Work arrangement**: remote
**Experience**: senior
**Job type**: Full time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://jobs.ashbyhq.com/openrouter/78fc4670-5ba0-4146-b8b1-1ef4d91b96f1?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_dac3c14e-5bf

## Description

OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers,without lock-in, capacity constraints, or unnecessary cost.

As a Site Reliability Engineer, Provider Operations, you will own the operational health of our provider supply. You will ensure every endpoint we route to is fast, correct, and available, and that we detect and route around problems before customers do.

## Responsibilities

- Build and own monitoring for every provider and endpoint: latency, throughput, error rates, uptime, and output correctness. Set SLOs per provider tier and alert on them.

- Improve how quickly we detect degraded endpoints, and work with the routing team so traffic shifts away from them automatically.

- Own on-call for provider incidents: triage, mitigate, communicate with providers, run postmortems, and drive follow-ups to closure.

- Turn telemetry into scorecards and SLO reporting that providers act on, and be the technical escalation point when a provider's endpoint is misbehaving.

- Build continuous canaries and evals that catch silent regressions.

- Replace manual provider-ops work with safe, auditable tooling.

- Build tooling to load-test endpoints before big launches.

## Requirements

- 4+ years in SRE, production engineering, or infrastructure roles running high-traffic, customer-facing systems.

- Strong with observability tooling and practice: metrics, tracing, logs, SLOs/error budgets, alerting that is always actionable.

- Capable software engineer who prefers writing tools over executing runbooks. TypeScript and/or Python.

- Experienced with distributed systems failure modes: timeouts, retries, backpressure, partial outages, noisy neighbors.

- Calm, clear incident commander who communicates well with external partners under pressure.

- Understands, or is eager to learn deeply, how LLM inference is served.

## Nice to Have

- Experience at an inference provider, model lab, GPU cloud, or API gateway/CDN company.

- Experience with our stack: TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, Vercel.

- Background in routing, load balancing, or traffic management systems.

- Experience with evals or synthetic monitoring for ML systems.

## Skills

### Required
- SRE
- observability tooling
- distributed systems
- incident command
- LLM inference

### Nice to have
- inference provider
- model lab
- GPU cloud
- API gateway
- CDN company
- TypeScript
- Cloudflare Workers
- Postgres
- ClickHouse
- GCP
- Vercel
- routing
- load balancing
- traffic management systems
- evals
- synthetic monitoring for ML systems

---

Source: [Apply at jobs.ashbyhq.com](https://jobs.ashbyhq.com/openrouter/78fc4670-5ba0-4146-b8b1-1ef4d91b96f1?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)