About The RoleAI Trainer jobs in Canada focus on improving large language models through RLHF-style evaluations, prompt evaluation, data labeling, and QA evaluation across real AI/ML training pipelines. You will follow detailed annotation guidelines, verify training data quality, and provide structured feedback that improves helpfulness, correctness, and safety.What You'll DoPerform RLHF evaluations (pairwise ranking, rubric-based scoring) and write transparent rationalesExecute prompt evaluation for instruction-following, factuality, and safetyLabel and validate datasets for NLP and content safety labelingRun QA evaluation checks (consistency, agreement, systematic error discovery)Document edge cases and build error taxonomies to drive model performance improvementCollaborate on rubrics, gold sets, calibration,



and regression testing for model updatesSkills And QualificationsExperience with structured evaluation and guideline-driven judgmentStrong writing and documentation for rationales and edge-case notesFamiliarity with RLHF, LLM evaluation, and prompt evaluation workflowsComfort with data labeling, QA evaluation, and training data quality processesBonus: multilingual evaluation, NER/classification tasks, or multimodal evaluationHow To ApplyBrowse roles on Rex.Zone and apply with a resume highlighting RLHF, data labeling, QA evaluation, annotation guidelines compliance, and examples of model evaluation feedback.Hourly base pay range: $30–$50.

📌 Ai Trainer Jobs In Canada (Riviere-des-Prairies—Pointe-aux-Trembles)
🏢 Rex.zone
📍 Riviere-des-Prairies—Pointe-aux-Trembles