• Role: Evaluation Analyst
•

Location:
Remote (United States & Canada Only)
• Employment Type: Contract

Location:
Applications are strictly restricted to individuals currently residing in and authorized to work in the United States or Canada. Submissions from other regions will be automatically filtered out. Overview: We are looking for a detail-oriented Evaluation Analyst to review, annotate, and structure multimodal datasets for advanced artificial intelligence models. You will play a crucial role in improving data quality across text, images, spreadsheets, and complex structured documents.

Key Responsibilities
• Systematically tag and structure complex data inputs while strictly adhering to formatting guidelines.
• Critically evaluate generative AI responses for logic, tone, safety, and factual correctness.
• Identify edge cases, labeling ambiguities, and data inconsistencies to help improve labeling taxonomies.
• Balance speed and meticulous attention to detail to achieve strict weekly productivity metrics.

Requirements:




• High-level critical analysis skills and the capacity to evaluate nuanced textual and visual data.
• Prior experience in data annotation, quality assurance, data review, or content evaluation is preferred.
• Impeccable command of the English language, including grammar, syntax, and cultural nuances.
• Consistent, high-speed broadband connection and a quiet remote working environment.
• Currently residing in the US or Canada with the ability to work standard North American hours. Equal Prospect Employer: We are an equal opportunity employer. We are committed to building an inclusive workplace and welcome applications from all qualified individuals regardless of race, color, ethnicity, nationality, gender, gender identity or expression, sexual orientation, age, religion, disability, marital status, or any other characteristic protected by applicable law. All hiring decisions are made solely on the basis of qualifications, skills, and demonstrated ability. Apply Now

📌 Evaluation Analyst (Canada)
🏢 Crewlia
📍 Canada