Description
We are seeking a Senior Software Engineer to join our Inference team, responsible for building and maintaining critical systems that serve Claude to millions of users worldwide. The team has a dual mandate: maximizing compute efficiency to serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models.
As a Senior Software Engineer, you will be responsible for designing, implementing, and deploying large-scale distributed systems, including intelligent request routing, fleet-wide orchestration, and load balancing. You will work closely with our research team to develop new inference features and integrate new AI accelerator platforms.
To succeed in this role, you should have significant software engineering experience, particularly with distributed systems, and be results-oriented with a bias towards flexibility and impact. You should also be able to pick up slack, even if it goes outside your job description, and thrive in environments where technical excellence directly drives both business results and research breakthroughs.
Responsibilities:
- Design and implement large-scale distributed systems, including intelligent request routing, fleet-wide orchestration, and load balancing
- Work closely with our research team to develop new inference features and integrate new AI accelerator platforms
- Collaborate with cross-functional teams to ensure seamless deployment and operation of our systems
- Analyze observability data to tune performance based on real-world production workloads
- Manage multi-region deployments and geographic routing for global customers
Requirements:
- Bachelor's degree or equivalent combination of education, training, and/or experience
- Significant software engineering experience, particularly with distributed systems
- Results-oriented with a bias towards flexibility and impact
- Ability to pick up slack, even if it goes outside your job description
- Thrives in environments where technical excellence directly drives both business results and research breakthroughs
Preferred Qualifications:
- Experience with Kubernetes and cloud infrastructure (AWS, GCP)
- Familiarity with machine learning systems and infrastructure
- Strong communication and collaboration skills
Benefits:
- Competitive compensation and benefits
- Optional equity donation matching
- Generous vacation and parental leave
- Flexible working hours
- Lovely office space in which to collaborate with colleagues
Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process