# Data Annotation Specialist, Safety

**Company**: Cohere
**Location**: Canada
**Work arrangement**: remote
**Job type**: contract
**Salary**: 45 CAD/hour or 40 USD/hour
**Category**: Data Science
**Industry**: Technology

**Apply**: https://jobs.ashbyhq.com/cohere/0cf19dbd-bfa9-425f-a357-e2bd874bb489?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_59f50ee6-a96

## Description

Our mission is to scale intelligence to serve humanity by training and deploying frontier models for developers and enterprises. We're looking for a Data Annotation Specialist with a background in Trust & Safety, Content Moderation, AI model evaluation, or related fields.

As a Data Annotation Specialist on safety tasks, you will evaluate and improve model safety by labeling, ranking, auditing, and refining human- and model-generated text. You'll apply nuanced safety judgment, assess model outputs against detailed safety guidelines, and create prompts and safety test cases.

Responsibilities:

- Evaluate and improve model safety: Label, rank, audit, and refine human- and model-generated text to improve safety, quality, and policy alignment.

- Apply nuanced safety judgment: Assess model outputs against detailed safety guidelines, rubrics, and style standards.

- Create prompts and safety test cases: Write realistic prompts, user scenarios, and adversarial examples to evaluate model behavior.

- Support quality and calibration: Identify annotation inconsistencies and provide actionable feedback.

- Work with precision and independence: Complete annotation tasks with strong attention to detail in a globally distributed, asynchronous team environment.

Requirements:

- 1+ years of experience in Content Moderation, Trust and Safety, AI data annotation, LLM evaluation, or a related analytical role.

- Experience applying detailed guidelines to complex and sensitive content.

- Emotional resilience: Comfort working with content that contains unsafe, explicit, and/or toxic content.

- Excellent command of written English and the ability to clearly justify content evaluations.

- Strong attention to detail and commitment to accuracy.

- Strong execution in a remote environment, including good time management and comfort using new tools.

We offer a contract rate of 45 CAD/hour or 40 USD/hour, depending on your location, with a minimum commitment of 16 hours per week. The contract is for 12 months with potential for extension.

Benefits:

- Competitive hourly rate

- Opportunity to work on high-impact projects

- Flexible remote work arrangement

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Content Moderation
- Trust and Safety
- AI data annotation
- LLM evaluation
- Written English

### Nice to have
- Fluency in another language

---

Source: [Apply at jobs.ashbyhq.com](https://jobs.ashbyhq.com/cohere/0cf19dbd-bfa9-425f-a357-e2bd874bb489?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)