Senior Data Labeling Jobs in Montreal (Remote) — Rex.zone

Rex.zone is hiring a Senior Data Labeling Specialist to improve training data quality for modern AI systems. This full-time, remote role supports LLM training pipelines through expert labeling, RLHF evaluation, prompt evaluation, and QA evaluation.

What You Will Do

- Label and review complex datasets for NLP and computer vision annotation, including content safety labeling

- Perform RLHF-style tasks: preference ranking, pairwise judgments, and rubric-based scoring

- Run QA evaluation to audit agreement, catch systematic errors, and enforce annotation guidelines compliance

- Complete NLP tasks such as named entity recognition, intent/sentiment classification, and span annotation

- Support CV workflows: bounding boxes, polygons, keypoints, segmentation masks, and video frame review

- Document edge cases, propose guideline updates,



and improve labeling operations over time

Required Qualifications

- Experience in data labeling / data annotation operations with robust quality ownership

- Ability to apply detailed rubrics and follow versioned guidelines consistently

- Comfort evaluating LLM outputs for helpfulness, harmlessness, and policy adherence

- Strong judgment, clear documentation, and ability to meet throughput and accuracy targets in a remote setting

Preferred Qualifications

- Experience with large language model evaluation, RLHF, and prompt evaluation

- Exposure to content policy interpretation and escalation workflows

- Experience reviewing others’ work and improving QA evaluation processes

Pay

Competitive hourly rate: $30–$50 per hour (USD).

📌 Senior Data Labeling Specialist (Montreal)
🏢 Rex.zone
📍 Montreal