Rex.zone is hiring full-time remote Online Generalists in Canada to support AI/ML data operations that power large language model training pipelines. You will complete online tasks such as data labeling, RLHF preference ranking, prompt evaluation, QA evaluation, and content safety labeling across NLP and computer vision datasets.

Responsibilities

Perform data labeling for NLP tasks (classification, summarization, named entity recognition) and LLM evaluation workflows

Create preference data for RLHF by ranking/scoring model outputs and writing clear rationales

Conduct prompt evaluation and response scoring using web-based evaluation interfaces

Execute QA evaluation, adjudication, and consistency checks to improve training data quality

Handle content safety labeling using policy-based decisions and detailed guidelines

Complete computer vision annotation including image tagging, bounding boxes,



and segmentation as needed

Document edge cases, follow versioned guidelines, and escalate ambiguity appropriately

Qualifications

Based in Canada and able to work full-time remotely

Solid reading comprehension, attention to detail, and consistent decision-making

Comfortable following detailed annotation guidelines and meeting quality standards

Experience in data labeling, QA evaluation, RLHF, or LLM evaluation is preferred but not required

Quality Standards

Maintain high guideline adherence, low error rates, and responsiveness to feedback

Support inter-annotator agreement and training data quality audits through careful self-checks

Compensation

Competitive hourly rate: $30–$50 per hour

#J-18808-Ljbffr

📌 Online Generalist Jobs in Canada (Manitoba)
🏢 Rex.zone
📍 Manitoba