AI Jobs in Canada (Remote, Full time) — Open Role

Rex.zone supports distributed AI/ML data operations that improve large language model evaluation and training data quality. This role focuses on production-grade workflows such as RLHF, data labeling, prompt evaluation, QA evaluation, and content safety labeling across NLP and (optionally) computer vision.

What You Will Do

- Execute RLHF evaluation, preference ranking, and rubric-based rationales

- Perform prompt evaluation and response grading (helpfulness/harmlessness/honesty)

- Complete data labeling tasks including named entity recognition and text classification

- Run QA evaluation via audits, spot checks, and inter-annotator agreement workflows

- Apply content safety labeling policies and maintain annotation guidelines compliance





- Document edge cases and surface systematic failure modes impacting LLM training pipelines

Required Qualifications

- Mid-Senior experience in AI data operations or applied ML support

- Strong written reasoning and comfort with rubric-based evaluation

- Familiarity with RLHF concepts and large language model evaluation

- Experience with labeling taxonomies (classification, NER, evaluation tasks)

- Comfort using web-based annotation tools, task queues, and spreadsheets

How To Apply

Apply via Rex.zone and include a brief summary of your RLHF evaluation, data labeling, prompt evaluation, or QA evaluation experience, plus any examples of improving training data quality or clarifying annotation guidelines.

📌 AI Jobs in Canada
🏢 Rex.zone
📍 Canada