Cyber Evaluations Engineer

About the Role

We're hiring Cyber Evaluations Engineers to build and run evaluations that measure cyber-relevant capabilities and safeguard robustness in our models. You will design new evaluations, run per-release robustness testing, and analyze data on jailbreaks and prompt bypasses.

Key Responsibilities

• Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new models
• Execute per-release safeguard-robustness testing ahead of major model launches
• Analyze evaluation results and communicate findings clearly to the team and stakeholders
• Design, prototype, and tune detection probes for cyber misuse
• Work with the cyber policy team to develop a layered, robust abuse-detection architecture
• Build and maintain internal tooling used to run and score evaluations
• Collaborate with policy and engineering partners to translate evaluation findings into safeguard improvements

Minimum Qualifications

• Experience building or running evaluations, benchmarks, or test suites for software or ML systems
• Hands-on cybersecurity experience
• Proficiency in Python
• Strong ability to communicate evaluation results with multiple stakeholders

Preferred Qualifications

• Deep offensive-security or security-research experience
• Experience analyzing adversarial or abuse data
• Experience working onsite with government partners
• Experience with AI/ML evaluation frameworks
• Familiarity with coordinated vulnerability disclosure practices
• Experience testing pre-release software or models under confidentiality constraints
• Experience authoring detection content or building ML-based abuse detection
• Active secret security clearance or higher

Logistics

• Annual Salary: $300,000-$405,000 USD
• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Required field of study: A field relevant to the role
• Location-based hybrid policy: 25% office time
• Visa sponsorship: Available