Staff Software Engineer, Inference

Job Overview

We are seeking a Staff Software Engineer to join our Inference team at Anthropic. Our team is responsible for building and maintaining critical systems that serve Claude to millions of users worldwide. As a Staff Software Engineer, you will work end-to-end to identify and address key infrastructure blockers to serve Claude while enabling breakthrough AI research.

Responsibilities

• Design and implement high-performance, large-scale distributed systems
• Develop and deploy machine learning systems at scale
• Work on load balancing, request routing, and traffic management systems
• Optimize LLM inference, batching, and caching strategies
• Experience with Kubernetes and cloud infrastructure (AWS, GCP)
• Proficiency in Python or Rust

Requirements

• Significant software engineering experience, particularly with distributed systems
• Results-oriented with a bias towards flexibility and impact
• Ability to pick up slack and go outside your job description
• Interest in learning more about machine learning systems and infrastructure
• Thrive in environments where technical excellence drives business results and research breakthroughs
• Care about the societal impacts of your work

Benefits

• Competitive compensation: €295,000-€355,000 EUR per year
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space

Company Culture

We believe that the highest-impact AI research will be big science. We work as a single cohesive team on just a few large-scale research efforts, valuing impact over smaller puzzles. We view AI research as an empirical science, similar to physics and biology.