# Senior Systems Engineer, AI Gateway

**Company**: Cloudflare
**Location**: Austin, TX
**Work arrangement**: onsite
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://job-boards.greenhouse.io/cloudflare/jobs/7560174?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_bf5b6ad9-b07

## Description

At Cloudflare, we're on a mission to help build a better Internet. We're looking for a Senior Systems Engineer to help build the AI Gateway layer, which should exist at the network edge: close to users, close to compute, and simple enough that a developer can adopt it with one API change.

Responsibilities:

- Build core AI Gateway systems that handle high-volume inference traffic across providers, models, and Cloudflare's global network.

- Design and implement APIs, routing primitives, observability features, controls, and developer workflows that make AI Gateway reliable and easy to adopt.

- Work across product and infrastructure boundaries with Workers AI, Agents, and the broader Developer Platform organization to make Cloudflare's AI platform feel like one coherent product.

- Turn ambiguous product and technical ideas into prototypes, design docs, shipped features, and measurable production improvements.

- Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.

- Build the software , and the software that builds the software: agents, tests, harnesses, evaluation loops, operational tools, and internal context that help the team move faster with confidence.

- Sweat the developer experience. Error messages, SDKs, dashboard flows, docs, examples, and API details all matter.

- Mentor other engineers through design review, code review, debugging, and technical leadership without needing people-management authority.

- Bring strong opinions, clear judgment, and a willingness to revise your view when data, users, or production reality prove otherwise.

Desirable Skills, Knowledge & Experience:

- 5+ years of experience building and operating production systems, ideally in AI infrastructure, developer platforms, cloud infrastructure, edge/proxy systems, high-scale APIs, or distributed systems.

- Strong systems engineering fundamentals: networking, APIs, reliability, observability, data modeling, performance, and operational tradeoffs.

- Experience designing or scaling distributed systems where latency, throughput, availability, and correctness all matter.

- Ability to work comfortably across the stack, from API design and product surfaces to backend services, queues, storage systems, control planes, or performance-critical code.

- Strong developer tools taste. You have used and built enough APIs, SDKs, dashboards, CLIs, docs, and internal platforms to know what makes them delightful or painful.

- Clear technical communication: you can write design docs, explain tradeoffs, review architecture, and align engineers and product partners around a practical path forward.

- A builder's bias toward working software. You can prototype quickly, ship incrementally, and improve systems while they are already in production.

- Operational judgment. You understand that at Cloudflare scale, rare bugs are not rare for long, and you build systems that are observable, resilient, and recoverable.

- Comfort using AI-native development workflows and curiosity about how agents, tools, and automation can improve engineering productivity.

## Skills

### Required
- systems engineering
- distributed systems
- high-throughput APIs
- developer-facing workflows
- AI infrastructure
- cloud infrastructure
- edge/proxy systems

### Nice to have
- AI/ML infrastructure
- inference platforms
- model gateways
- LLM-powered applications
- provider abstraction layers
- TypeScript
- Go
- Rust

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/cloudflare/jobs/7560174?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)