Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across a wide range of topics.
Perform fact-checking using reliable public sources and external tools.
Create high-quality human evaluation data by annotating response strengths, gaps, and factual errors.
Assess reasoning quality, tone, clarity, and completeness of AI-generated outputs.
Ensure responses follow expected conversational behavior and system guidelines.
Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.
Requirements Native-level or near-native fluency in French (ILR 5 / CEFR C2) with robust English proficiency.
Proven experience using large language models and understanding real-world LLM use cases.
Excellent writing skills with the ability to provide explicit, nuanced, and structured feedback.
Robust attention to detail and analytical thinking.
Ability to work across multiple topics, domains, and evolving requirements.
Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering.
J-18808-Ljbffr

📌 Teacher $36 16/hr Remote Manitoba
🏢 Crossing Hurdles
📍 Manitoba