# Software Engineer, AI Gateway

**Company**: Vercel
**Location**: San Francisco, CA
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Salary**: $196,000-$294,000
**Category**: Engineering
**Industry**: Technology

**Apply**: https://job-boards.greenhouse.io/vercel/jobs/5798406004?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_7beafb2b-4fe

## Description

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers.

You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities.

This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

## Responsibilities

- Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.

- Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.

- Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.

- Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.

- Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

## Requirements

- 5+ years of relevant experience

- Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure

- Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)

- Experience contributing to or participating in open source projects

- Excellent communication skills and the ability to work effectively in a collaborative team environment

## Benefits & Compensation

- Competitive compensation package, including equity.

- Inclusive Healthcare Package.

- Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.

- Flexible Time Off.

- We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.

The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role.

## Skills

### Required
- JavaScript
- TypeScript
- backend development
- APIs
- cloud infrastructure
- AI/ML integrations
- API gateways
- distributed systems

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/vercel/jobs/5798406004?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)