Evaluate AI safety remotely with Cohere using contextual judgment, content moderation expertise, and detailed written English evaluations. This part-time contract serves Canada and the United States.
As a Data Annotation Specialist, you will improve Large Language Model safety through labeling, ranking, auditing, prompting, and output correction. The work requires Trust & Safety, content moderation, AI model evaluation, or related experience. You will assess sensitive content against nuanced guidelines and support consistent model behavior.
Key Responsibilities:
- Label, rank, audit, and refine human-generated and model-generated text
- Apply safety guidelines across ambiguous and context-dependent cases
- Create prompts, user scenarios, and adversarial safety examples
- Identify annotation inconsistencies and provide actionable edge-case feedback
- Complete precise tasks independently in asynchronous remote workflows
Requirements:
- One or more years in content moderation, Trust & Safety, or AI annotation
- Experience evaluating complex, sensitive content using detailed guidelines
- Comfort with explicit, unsafe, toxic, or disturbing content
- Excellent written English and transparent evaluation justifications
- Strong accuracy, consistency, time management, and independent execution
Apply safety judgment, prompt-writing skill, and annotation precision to improve Cohere’s models through remote contract work.
📌 AI Safety Data Annotation Specialist (Canada)
🏢 Cohere
📍 Canada