Data Annotation Specialist, Safety

Our mission is to scale intelligence to serve humanity by training and deploying frontier models for developers and enterprises. We're looking for a Data Annotation Specialist with a background in Trust & Safety, Content Moderation, AI model evaluation, or related fields.

As a Data Annotation Specialist on safety tasks, you will evaluate and improve model safety by labeling, ranking, auditing, and refining human- and model-generated text. You'll apply nuanced safety judgment, assess model outputs against detailed safety guidelines, and create prompts and safety test cases.

Responsibilities:

• Evaluate and improve model safety: Label, rank, audit, and refine human- and model-generated text to improve safety, quality, and policy alignment.
• Apply nuanced safety judgment: Assess model outputs against detailed safety guidelines, rubrics, and style standards.
• Create prompts and safety test cases: Write realistic prompts, user scenarios, and adversarial examples to evaluate model behavior.
• Support quality and calibration: Identify annotation inconsistencies and provide actionable feedback.
• Work with precision and independence: Complete annotation tasks with strong attention to detail in a globally distributed, asynchronous team environment.

Requirements:

• 1+ years of experience in Content Moderation, Trust and Safety, AI data annotation, LLM evaluation, or a related analytical role.
• Experience applying detailed guidelines to complex and sensitive content.
• Emotional resilience: Comfort working with content that contains unsafe, explicit, and/or toxic content.
• Excellent command of written English and the ability to clearly justify content evaluations.
• Strong attention to detail and commitment to accuracy.
• Strong execution in a remote environment, including good time management and comfort using new tools.

We offer a contract rate of 45 CAD/hour or 40 USD/hour, depending on your location, with a minimum commitment of 16 hours per week. The contract is for 12 months with potential for extension.

Benefits:

• Competitive hourly rate
• Opportunity to work on high-impact projects
• Flexible remote work arrangement