• Role: QA Reviewer (Remote)
•

Location:
Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
• Pay: US$18 per hour Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States. Overview We are recruiting consistent contributors to provide a second quality check on completed AI evaluation tasks. You will verify earlier decisions, resolve differences through the project rubric, and leave evidence that supports the final outcome.

Key Responsibilities
- Recheck completed evaluations against the original input, output, and scoring criteria.
- Compare the initial decision with the available evidence and identify unsupported ratings or labels.
- Use calibration examples to resolve common interpretation differences across similar tasks.
- Distinguish isolated reviewer mistakes from unclear guidance or repeatable quality patterns.




- Record the final disposition and a concise reason whenever an earlier decision changes. Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to independently reassess completed work without relying on the first decision.
- Ability to reconcile differing judgments through written criteria and calibration examples.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience with quality review, evaluation checking, or annotation review is helpful but not required. Equal Prospect We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law. Apply Now

📌 QA Reviewer (Canada)
🏢 Crewlia
📍 Canada