Evaluate AI-generated responses remotely for clarity, accuracy, and human reasoning while developing prompts across generalist subject areas. Work asynchronously as an independent contractor.Mercor connects creative and technical talent with leading AI research labs and is seeking a Generalist Expert. The assignment lasts approximately two weeks, with potential extension, and requires ten to twenty-five hours weekly. You will benchmark model responses, identify failure points, and maintain consistent quality across summaries, Q&A, and synthesis tasks. Research, writing, editing, education,



or related analytical experience supports this work.Key Responsibilities:Review and revise responses for clarity and accuracyCreate prompts spanning a range of generalist topicsBenchmark responses by identifying model failure pointsCompare variations in length, style, and system promptsMeet deadlines while improving AI model performanceRequirements:Two or more years of relevant analytical experienceStrong ability to explain complex topics conciselyCareful attention to detail and critical thinkingComfort working independently as guidelines evolveFamiliarity with LLMs preferredBring research judgment, concise communication, and response evaluation skills to Mercor's AI benchmarking and prompt-development work.

📌 Generalist Expert Ai Evaluator (Calgary)
🏢 Mercor
📍 Calgary