# Member of Technical Staff - RL Inference

**Company**: xAI
**Location**: Palo Alto, CA
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology
**Wikidata**: https://www.wikidata.org/wiki/Q120599684

**Apply**: https://job-boards.greenhouse.io/xai/jobs/5180223007?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_9aaf3a01-1b8

## Description

## About the Role

The RL infrastructure team at xAI is seeking an engineer to contribute to low-precision RL training and inference.

## Responsibilities

- Design and optimize the inference stack for various RL workloads, from small-scale ablations to production training runs.

- Analyse, profile, and address performance bottlenecks in large-scale RL systems.

- Collaborate with the modelling team to implement novel RL techniques and algorithms efficiently.

## Basic Qualifications

- Experience in building, debugging, and optimizing large-scale distributed systems.

- Experience in LLM inference.

- Proficiency in programming languages such as Python, C++, and/or Rust; frameworks such as PyTorch, Jax, CUDA.

- Willingness to tackle complex problems at all levels of the stack.

## Preferred Skills and Experience

- Strong knowledge in quantization and numerics in LLM inference and training.

- Experience in developing inference engines, e.g., SGLang, vLLM.

## Skills

### Required
- Python
- C++
- Rust
- PyTorch
- Jax
- CUDA
- large-scale distributed systems
- LLM inference

### Nice to have
- quantization
- numerics in LLM inference and training
- inference engines
- SGLang
- vLLM

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/xai/jobs/5180223007?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)