Senior Data Labeling Jobs in Montreal (Remote) — Rex.zone

Rex.zone is hiring a Senior Data Labeling Specialist to improve training data quality for modern AI systems. This full time, remote role supports LLM training pipelines through expert labeling, RLHF evaluation, prompt evaluation, and QA evaluation.

What You Will Do
Label and review complex datasets for NLP and computer vision annotation, including content safety labeling
Perform RLHF-style tasks: preference ranking, pairwise judgments, and rubric-based scoring
Run QA evaluation to audit agreement, catch systematic errors, and enforce annotation guidelines compliance
Complete NLP tasks such as named entity recognition, intent/sentiment classification, and span annotation
Support CV workflows: bounding boxes, polygons, keypoints, segmentation masks, and video frame review
Document edge cases, propose guideline updates,



and improve labeling operations over time

Required Qualifications
Experience in data labeling / data annotation operations with robust quality ownership
Ability to apply detailed rubrics and follow versioned guidelines consistently
Comfort evaluating LLM outputs for helpfulness, harmlessness, and policy adherence
Solid judgment, clear documentation, and ability to meet throughput and accuracy targets in a remote setting

Preferred Qualifications
Experience with large language model evaluation, RLHF, and prompt evaluation
Exposure to content policy interpretation and escalation workflows
Experience reviewing others’ work and improving QA evaluation processes

Pay

Competitive hourly rate: $30–$50 per hour (USD).

📌 Senior Data Labeling Specialist Montreal
🏢 Rex.zone
📍 Montreal