Engineering Manager, Inference

About the role:

As an Engineering Manager on Anthropic's performance and scaling teams, you will be responsible for ensuring the team is identifying and removing bottlenecks, building robust and durable solutions, and maximizing the efficiency of our systems.

Responsibilities:

• Provide front-line leadership of engineering efforts to improve model performance and scale our inference and training systems
• Become familiar with the team's technical stack enough to make targeted contributions as an individual contributor
• Manage day-to-day execution of the team's work
• Prioritize the team's work and manage projects in a highly dynamic, fast-paced environment
• Coach and support your reports in understanding, and pursuing, their professional growth
• Maintain a deep understanding of the team's technical work and its implications for AI safety

Requirements:

• 1+ years of management experience in a technical environment, particularly performance or distributed systems
• Background in machine learning, AI, or a similar related technical field
• Deeply interested in the potential transformative effects of advanced AI systems and committed to ensuring their safe development
• Excel at building strong relationships with stakeholders at all levels
• Quick learner, capable of understanding and contributing to discussions on complex technical topics
• Experience managing teams through periods of rapid growth and change

Nice to have:

• High performance, large-scale ML systems
• GPU/Accelerator programming
• ML framework internals
• OS internals
• Language modeling with transformers

Compensation:

The annual compensation range for this role is $425,000-$560,000 USD.