Data Infrastructure Engineer, Pre-training

Anthropic is at the forefront of AI research, dedicated to developing safe, ethical, and powerful artificial intelligence. We are seeking a Staff level Engineer to join our Pre-training team, responsible for developing the next generation of large language models.

Responsibilities

• Design and implement data processing infrastructure for large language model training (highly performant, reproducible, traceable)
• Develop and maintain core processing primitives (e.g., tokenization, deduplication, chunking) with a focus on scalability
• Build robust systems for data quality assurance and validation at scale
• Collaborate with research teams to implement novel data processing architectures
• Build and operate end-to-end data pipelines that turn raw web-scale corpora into training-ready datasets

Requirements

• 5+ YOE outside of internships
• Strong software engineering skills with experience building high-throughput fault-tolerant distributed systems
• Hands-on experience with distributed computing frameworks, particularly Apache Spark
• Excellent problem-solving skills and attention to detail
• Strong communication skills and ability to work in a collaborative environment
• Advanced degree in Computer Science or related field
• Experience with language model training infrastructure
• Background in Data Infrastructure, MLOps, or ML infrastructure

Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space in which to collaborate with colleagues

Logistics

• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
• Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
• Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time.
• Visa sponsorship: We do sponsor visas!