Role: Prompt Response Evaluator (Remote) Location: Remote (Australia, Canada, UK, Ireland, New Zealand, United States) Engagement Type: Hourly Contract Applicants must currently reside in Australia, Canada, UK, Ireland, New Zealand or the United States.
Overview We are recruiting contributors to evaluate AI outputs for AI projects. You will use the supplied evaluation criteria to guide your work and record findings about accuracy, reasoning, relevance, and instruction-following issues for review.
Key Responsibilities - Evaluate AI outputs against the supplied evaluation criteria.
- Compare similar examples before making close quality decisions.
- Identify the specific evidence that supports each judgment.
- Resolve duplicate examples without losing meaningful contextual differences.
- Record findings about accuracy, reasoning, relevance,
and instruction-following issues and flag unresolved questions for review.
Requirements - Professional-level English proficiency, both written and verbal.
- Ability to evaluate AI outputs consistently against the supplied evaluation criteria.
- Ability to consolidate duplicate examples while preserving relevant differences.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience in AI output evaluation, content review or quality checking is preferred.
Equal Chance We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.