AI Jobs in Canada (Remote, Full-Time) — Open Role Rex.zone supports distributed AI/ML data operations that improve large language model evaluation and training data quality. This role focuses on production-grade workflows such as RLHF, data labeling, prompt evaluation, QA evaluation, and content safety labeling across NLP and (optionally) computer vision. What You Will Do
• Execute RLHF evaluation, preference ranking, and rubric-based rationales
• Perform prompt evaluation and response grading (helpfulness/harmlessness/honesty)
• Complete data labeling tasks including named entity recognition and text classification
• Run QA evaluation via audits, spot checks, and inter-annotator agreement workflows
• Apply content safety labeling policies and maintain annotation guidelines compliance




• Document edge cases and surface systematic failure modes impacting LLM training pipelines Required Qualifications
• Mid-Senior experience in AI data operations or applied ML support
• Robust written reasoning and comfort with rubric-based evaluation
• Familiarity with RLHF concepts and large language model evaluation
• Experience with labeling taxonomies (classification, NER, evaluation tasks)
• Comfort using web-based annotation tools, task queues, and spreadsheets

How To Apply
Apply via Rex.zone and include a brief summary of your RLHF evaluation, data labeling, prompt evaluation, or QA evaluation experience, plus any examples of improving training data quality or clarifying annotation guidelines.

📌 AI Jobs in Canada
🏢 Rex.zone
📍 Canada