Description
About the role
Anthropic gives independent external evaluators access to its models, people, and safety practices to assess risks, processes, and policies. The company is hiring a Technical Program Manager to establish and deepen partnerships with these external reviewers and embedded evaluators.
The Technical Program Manager will be the main point of contact for existing partners, deepening support for effective work and high-quality publications. They will also broaden the portfolio of organisations worked with, managing the funnel from first conversation through contracting, onboarding, and day-to-day access, culminating in published reports.
The goal is to evolve current manual processes into a system supporting many evaluators, working with teams across Safety, Research, Security, Legal, People Services, IT, Policy, and Communications. Within six months, the Technical Program Manager should be able to take a new evaluator from contract negotiation to first published report with minimal senior leader involvement.
Key responsibilities
- Own the external evaluator program end-to-end, including relationships with evaluator organisations and the pipeline of future partners.
- Take each evaluator from first conversation through scoping, contracting, onboarding, access, and review to a published report.
- Define the stages and tiers of working with evaluators and develop information access policies that meet evaluators' needs while protecting security and confidential information.
- Drive evaluators' access and information requests to fast, well-documented decisions in partnership with Research, Security, Legal, and IT.
- Drive the technical design of evaluator access with Security, IT, and infrastructure teams.
- Run the review process for evaluator reports against agreed timelines and redaction criteria.
- Scope evaluations with researchers and engineers, turning evaluators' questions into concrete requirements for model access, data, tooling, and compute.
- Turn evaluators' technical findings into research and engineering work with owners and dates.
- Keep the company informed with regular updates on the program.
- Collect feedback from evaluators and internal teams, run retrospectives, and iterate on policies and practices.
- Use Claude and work with engineering teams to build tooling for the program.
Minimum qualifications
- Experience leading complex technical programs with engineering or research teams.
- Experience managing relationships with external organisations.
- Strong program management skills.
- Technical fluency in how frontier AI models are trained, evaluated, and monitored.
- Sound judgment and discretion with confidential and sensitive information.
The annual compensation range for this role is $290,000-$365,000 USD.
For more fresh new jobs, check out yubhub.co.