Compare AI-generated media and identify visual or audio errors using careful observation and precise written explanations. Work remotely on your own schedule.

As an Outlier evaluator, you will assess image, video, audio, and voice outputs against prompts or source material. Tasks include ranking alternatives, labeling actions in first-person videos, and rating speech for naturalness, pronunciation, and voice matching. Your evaluations enter Outlier’s feedback loop for advanced AI systems.

Key Responsibilities:

- Judge image pairs for prompt adherence and visual quality
- Rank videos against prompts or source clips
- Label individual actions in hands-on task videos
- Rate speech naturalness, pronunciation, and voice matching
- Record short voice explanations when required

Requirements:

- Fluent English speaking and writing skills
- Ability to zoom, replay, and inspect outputs closely
- Comfort discussing realistic situations naturally
- Clear decision-making when alternatives contain flaws
- Bachelor’s degree or above is nice to have

Bring detailed media judgment and transparent communication to Outlier’s image, video, caption, audio, and voice evaluation projects.

📌 AI Image Video Audio Evaluator (Calgary)
🏢 Outlier
📍 Calgary