Description
As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms.
You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards.
The work sits at the intersection of biosecurity threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm.
This role is a fit for someone who understands the dual-use nature of biology and enabling technologies well enough to separate the benign from the malicious.
You will own and continuously improve the enforcement monitoring workflows for the bio-harms area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering cross-functional partners to accomplish tasks at scale.
Safety is core to our mission, and your work will directly protect individuals, communities, and critical systems.
Important context for the role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature.
The role also carries a shared on-call responsibility across the Policy and Enforcement teams.
Key responsibilities
- Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems.
- Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes.
- Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action.
- Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
- Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
- Proactively surface trends and propose improvements to detection methods and review workflows.
- Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations.
- Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
- Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations.
Minimum qualifications
- Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field.
- Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
- Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
- Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
- Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
- Communicate clearly in writing and can translate technical bio concepts for diverse audiences, including both technical and non-technical stakeholders.
Preferred qualifications
- Subject matter expertise in biodefense, biosecurity, WMD/CBRNE non-proliferation, or threat-intelligence.
- An understanding of where real-world biological risk actually lies , adversary intent, acquisition and weaponization pathways, and dual-use concerns, including familiarity with cross-platform threat analysis and open-source intelligence (OSINT) techniques relevant to weapons of mass destruction.
- Proficiency in SQL and/or other data analysis tools to draw insights from large datasets and monitor enforcement workflow health.
- Familiarity with dual-use research of concern (DURC), select agents, and relevant policy frameworks.
The annual compensation range for this role is $245,000-$285,000 USD.