Rex.zone is hiring full-time remote Online Generalists in Canada to support AI/ML data operations that power large language model training pipelines. You will complete online tasks such as data labeling, RLHF preference ranking, prompt evaluation, QA evaluation, and content safety labeling across NLP and computer vision datasets.

Responsibilities

- Perform data labeling for NLP tasks (classification, summarization, named entity recognition) and LLM evaluation workflows
- Create preference data for RLHF by ranking/scoring model outputs and writing clear rationales
- Conduct prompt evaluation and response scoring using web-based evaluation interfaces
- Execute QA evaluation, adjudication, and consistency checks to improve training data quality
- Handle content safety labeling using policy-based decisions and detailed guidelines
- Complete computer vision annotation including image tagging, bounding boxes,



and segmentation as needed
- Document edge cases, follow versioned guidelines, and escalate ambiguity appropriately

Qualifications

- Based in Canada and able to work full-time remotely
- Solid reading comprehension, attention to detail, and consistent decision-making
- Comfortable following detailed annotation guidelines and meeting quality standards
- Experience in data labeling, QA evaluation, RLHF, or LLM evaluation is preferred but not required

Quality Standards

- Maintain high guideline adherence, low error rates, and responsiveness to feedback
- Support inter-annotator agreement and training data quality audits through careful self-checks

Compensation

- Competitive hourly rate: $30–$50 per hour

📌 Online Generalist Jobs in Canada (Vancouver)
🏢 Rex.zone
📍 Vancouver