15 Nov
|
Crossing Hurdles
|
Canada
15 Nov
Crossing Hurdles
Canada
Position: Domain Contributor - Evaluation Specialist
Type: Contract
Compensation: $30 - $60/hour
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
- Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
- Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
- Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
- Document explicit rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
- Apply detailed task guidelines and evaluation rubrics consistently to each submission.
Requirements
- Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
- Deep expertise in a core domain: history, archival or library science, law, finance, journalism, or technology/industry history.
- Advanced research skills with a track record of verifying complex claims against authoritative sources.
- Exceptional written and verbal communication skills to articulate findings and feedback.
- Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
Application Process
- Easy Apply on LinkedIn
- Check email for next steps
- Participate in resume evaluation & interview stage
📌 AI Researcher | $60/hr Remote (Canada)
🏢 Crossing Hurdles
📍 Canada