# Data Infrastructure Engineer, Pre-training

**Company**: Anthropic
**Location**: San Francisco, CA
**Work arrangement**: hybrid
**Experience**: staff
**Job type**: full-time
**Salary**: $500,000-$850,000 USD
**Category**: Engineering
**Industry**: Technology
**Wikidata**: https://www.wikidata.org/wiki/Q116758847

**Apply**: https://job-boards.greenhouse.io/anthropic/jobs/4973067008?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_b1fdc18b-337

## Description

Anthropic is at the forefront of AI research, dedicated to developing safe, ethical, and powerful artificial intelligence. We are seeking a Staff level Engineer to join our Pre-training team, responsible for developing the next generation of large language models.

## Responsibilities

- Design and implement data processing infrastructure for large language model training (highly performant, reproducible, traceable)

- Develop and maintain core processing primitives (e.g., tokenization, deduplication, chunking) with a focus on scalability

- Build robust systems for data quality assurance and validation at scale

- Collaborate with research teams to implement novel data processing architectures

- Build and operate end-to-end data pipelines that turn raw web-scale corpora into training-ready datasets

## Requirements

- 5+ YOE outside of internships

- Strong software engineering skills with experience building high-throughput fault-tolerant distributed systems

- Hands-on experience with distributed computing frameworks, particularly Apache Spark

- Excellent problem-solving skills and attention to detail

- Strong communication skills and ability to work in a collaborative environment

- Advanced degree in Computer Science or related field

- Experience with language model training infrastructure

- Background in Data Infrastructure, MLOps, or ML infrastructure

## Benefits

- Competitive compensation and benefits

- Optional equity donation matching

- Generous vacation and parental leave

- Flexible working hours

- Lovely office space in which to collaborate with colleagues

## Logistics

- Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience

- Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

- Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

- Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time.

- Visa sponsorship: We do sponsor visas!

## Skills

### Required
- Apache Spark
- distributed computing
- data processing infrastructure
- language model training infrastructure
- MLOps
- ML infrastructure

### Nice to have
- Python
- Rust
- high-throughput fault-tolerant distributed systems

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/anthropic/jobs/4973067008?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)