• Role: AI Output Evaluator (Remote)
•

Location:
Remote (Australia, Canada, Ireland, Recent Zealand, United Kingdom, United States)
• Pay: US$18 per hour Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States. Overview We are recruiting careful contributors to judge individual AI outputs against their prompts and reference material. You will determine whether each output is correct and complete, assign the required outcome, and support it with concise evidence.

Key Responsibilities
- Check that an output follows every explicit instruction and respects the requested scope and format.
- Compare statements and conclusions with the reference answer or source context when one is provided.
- Mark omissions, contradictions, fabricated details, and reasoning that does not support the conclusion.
- Choose the appropriate rating or pairwise preference using the supplied decision rules.




- Quote or summarize the decisive portion of the output in the evaluation rationale. Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to interpret prompts, references, and rating rules as one evaluation package.
- Ability to identify the exact output evidence that determines a score or preference.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience with AI output evaluation, content review, or structured scoring is helpful but not required. Equal Opportunity We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law. Apply Now

📌 AI Output Evaluator (Canada)
🏢 Crewlia
📍 Canada