Senior Data Labeling Jobs in Montreal (Remote) — Rex.zone

Rex.zone is hiring a Senior Data Labeling Specialist to improve training data quality for modern AI systems. This full time, remote role supports LLM training pipelines through expert labeling, RLHF evaluation, prompt evaluation, and QA evaluation.

What You Will Do

- Label and review complex datasets for NLP and computer vision annotation, including content safety labeling

- Perform RLHF-style tasks: preference ranking, pairwise judgments, and rubric-based scoring

- Run QA evaluation to audit agreement, catch systematic errors, and enforce annotation guidelines compliance

- Complete NLP tasks such as named entity recognition, intent/sentiment classification, and span annotation

- Support CV workflows: bounding boxes, polygons, keypoints, segmentation masks, and video frame review

- Document edge cases, propose guideline updates,



and improve labeling operations over time

Required Qualifications

- Experience in data labeling / data annotation operations with strong quality ownership

- Ability to apply detailed rubrics and follow versioned guidelines consistently

- Comfort evaluating LLM outputs for helpfulness, harmlessness, and policy adherence

- Strong judgment, clear documentation, and ability to meet throughput and accuracy targets in a remote setting

Preferred Qualifications

- Experience with large language model evaluation, RLHF, and prompt evaluation

- Exposure to content policy interpretation and escalation workflows

- Experience reviewing others’ work and improving QA evaluation processes

Pay

Competitive hourly rate: $30–$50 per hour (USD).

📌 Senior Data Labeling Specialist (Montreal)
🏢 Rex.zone
📍 Montreal