Safeguards Enforcement Analyst, Violence & Extremism

As a Safeguards Enforcement Analyst focused on Violence & Extremism, you will build and execute operational workflows to assess model behavior, drive enforcement decisions, and develop evals across a technically demanding range of policy areas.

Your work spans detecting and mitigating attempts to misuse Anthropic's AI systems to facilitate real-world harm, including weapons and dangerous technology, critical infrastructure attacks, violent extremism, and threats of violence.

Key Responsibilities:

• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy
• Develop and maintain evals that measure model performance on these policy areas, surface regressions, and inform policy and model improvements
• Partner with Engineering and Data Science to optimize detection and automated enforcement systems for potential policy violations
• Review flagged content to drive enforcement decisions and surface policy gaps
• Support the Safeguards policy design team by providing structured feedback on policy gaps and enforcement ambiguities
• Develop and maintain enforcement guidelines and reviewer documentation
• Keep up to date with emerging threats, terrorist and extremist movements, regulatory changes, and AI policy enforcement best practices
• Identify and escalate emerging misuse patterns, novel attack vectors, and signs of coordinated violent extremist activity

Minimum Qualifications:

• Experience in policy enforcement, threat intelligence, counterterrorism, government, or a closely related field
• Experience standing up and scaling policy enforcement or content review workflows
• Proficiency in SQL and/or other data analysis tools
• Experience identifying emerging risks and threat actors
• Experience working with generative AI products
• Understanding of the challenges involved in implementing product policies at scale

Preferred Qualifications:

• Subject matter expertise in high-stakes harm areas
• Familiarity with relevant legal and regulatory frameworks
• Experience developing evals or red-teaming AI systems
• Experience with threat actor profiling and threat intelligence frameworks
• Experience tracking threat actors, extremist networks, or misuse patterns
• Experience with large language models
• Proficiency in Python for data analysis and workflow automation
• Background in law enforcement, national security, defense, counterterrorism, or a relevant regulatory environment

Logistics:

• Annual Salary: $285,000-$330,000 USD
• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time.