About Rex.zone

Rex.zone is hiring for remote data labeling jobs aligned to Ottawa job seekers supporting AI/ML training workflows. You will create and evaluate high-quality training data for large language models and computer vision systems, improving training data quality and model performance.

What You Will Do

- Label and review text, image, audio, or video data using project-specific annotation tools and taxonomies.

- Follow annotation guidelines compliance requirements and document edge cases for consistent decision-making.

- Complete RLHF tasks such as preference ranking, pairwise comparisons, and rubric-based scoring for LLM outputs.

- Perform prompt evaluation and response grading for helpfulness, correctness, and safety.

- Execute QA evaluation by auditing samples, measuring inter-annotator agreement, and escalating ambiguity.

- Apply named entity recognition (NER) labels and structured extraction schemas for NLP datasets.





- Support computer vision annotation (bounding boxes, segmentation masks, keypoints) when assigned.

- Contribute to content safety labeling for policy categories (hate, harassment, self-harm, sexual content) as required.

- Provide feedback to improve guidelines, reduce ambiguity, and increase throughput without sacrificing quality.

Required Qualifications

- Mid-Senior experience with data labeling or data annotation in AI/ML production settings.

- Experience with LLM evaluation workflows (RLHF, prompt evaluation, or QA evaluation).

- Robust written communication and structured reasoning for labeling rationale and dispute resolution.

- Comfort working remotely with asynchronous collaboration, quality targets, and audit-driven processes.

Compensation

Hourly base pay range

$30–$50/hr (USD)

.

📌 Remote Data Labeling Jobs in Ottawa
🏢 Rex.zone
📍 Ottawa