Overview:

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

Project Details:

Start Date: ASAP

Duration: 10 hours/week

Job Type: Freelance

Location: Remote (Canada)

Language: English(Canada)

Pay Rate: US$26/hour

What You'll do:
Listen carefully to recorded conversations between a person and an AI voice agent
Rate each of the agent's turns on two independent 1–5 scales:
Content – Was the response helpful, relevant, and appropriate?
Prosody – Did the voice sound natural, well-paced, and expressive?
Write a short, specific, and explicit justification for each score given

What We're Looking For:
Solid listening and attention-to-detail skills
Ability to give consistent, well-reasoned ratings
Transparent, concise written communication
Reliable availability for ~10 hours/week

Thank you for your interest in joining Welo Data's community and contributing to this exciting project. We look forward to collaborating with you!

📌 English Audio Rater Toronto
🏢 Welocalize
📍 Toronto