• Role: Test Evaluation Specialist
•

Location:
Remote (United States & Canada Only)
• Employment Type: Contract

Location:
Applications are strictly restricted to individuals currently residing in and authorized to work in the United States or Canada. Submissions from other regions will be automatically filtered out. Overview: We are looking for a detail-oriented Test Evaluation Specialist to review, annotate, and structure multimodal datasets for advanced artificial intelligence models. You will play a crucial role in improving data quality across text, images, spreadsheets, and complex structured documents.

Key Responsibilities
• Annotate, categorize, and validate large-scale multimodal datasets according to strict project guidelines.
• Review AI model outputs for factual accuracy, linguistic coherence, alignment, and formatting correctness.
• Identify edge cases, labeling ambiguities, and data inconsistencies to help improve labeling taxonomies.
• Maintain high accuracy, quality benchmarks, and daily throughput goals.

Requirements:




• High-level critical analysis skills and the capacity to evaluate nuanced textual and visual data.
• Background in editing, technical writing, QA testing, or data labeling is highly advantageous.
• Impeccable command of the English language, including grammar, syntax, and cultural nuances.
• Must possess a stable high-speed internet connection (minimum 25 Mbps) and a private workspace.
• Geographically located within the US or Canada (applications from other regions will be rejected). Equal Chance Employer: We are an equal opportunity employer. We are committed to building an inclusive workplace and welcome applications from all qualified individuals regardless of race, color, ethnicity, nationality, gender, gender identity or expression, sexual orientation, age, religion, disability, marital status, or any other characteristic protected by applicable law. All hiring decisions are made solely on the basis of qualifications, skills, and demonstrated ability. Apply Now

📌 Test Evaluation Specialist (Canada)
🏢 Crewlia
📍 Canada