About The Role

AI Training Jobs in Canada focus on building and evaluating AI/ML training data for LLM training pipelines. In this full-time remote role, you will label and evaluate text, image, and multimodal data to improve training data quality and model performance.

What You Will Do

- Perform data labeling for NLP, LLM, and computer vision annotation tasks

- Execute RLHF ranking and pairwise preference judgments

- Run QA evaluation checks and maintain annotation guidelines compliance

- Conduct prompt evaluation and response grading for helpfulness, correctness, and safety

- Apply content safety labeling (e.g., harassment, self-harm, adult content)

- Document edge cases, write clear rationales, and escalate ambiguous examples

- Collaborate asynchronously with cross-functional teams while following secure data handling practices

Required Qualifications





- Mid-Senior experience in AI/ML data operations, evaluation, or large-scale annotation programs

- Robust analytical writing and rubric-driven decision-making

- Familiarity with LLM training pipelines, dataset QA, and common annotation error sources

- Experience with NLP (classification, NER) and/or computer vision annotation workflows

- Ability to meet throughput targets and maintain high agreement rates in remote settings

Workflow and Tools

- Queue-based task routing with SLAs, audit trails, and spot audits

- Calibration sessions, gold-standard checks, and feedback loops

- Issue tracking for edge cases and guideline updates

- Privacy-first, secure remote work practices

Compensation

Hourly rate: $30–$50/hr (USD)

📌 AI Training Jobs in Canada
🏢 Rex.zone
📍 Canada