Applied Health & Medicine Benchmark Specialist

Position: Applied Health & Medicine Benchmark Specialist

Type: Hourly Contract

Compensation: $94–$119/hour

Location: Remote

About the Opportunity

Mercor is seeking experienced medical and health science professionals to author and review high-quality academic assessment content for an AI research initiative. You will create and evaluate rigorous multiple-choice questions across core health and medicine domains, assess solution quality, and help establish gold-standard benchmarks designed to advance AI capabilities.

You may contribute through one of two task types: Question Authoring or Question Verification.

Task Types

Question Authoring

- Create original, challenging multiple-choice questions within your area of medical expertise.
- Develop questions that assess deep conceptual understanding rather than surface-level recall.
- Rate each question according to its difficulty.
- Submit questions for review and refinement.

Question Verification

- Review pre-written questions for accuracy, clarity, completeness, precision, and rigor.
- Identify ambiguities, factual issues, missing information, or problems affecting solvability.
- Edit questions where necessary.
- Rate question difficulty and document the changes made.

Health & Medicine Domains

- Clinical Medicine & Surgery
- Medical Imaging & Diagnostics
- Pharmacovigilance
- Healthcare Management & Economics
- Rehabilitation & Allied Health

Responsibilities

- Author original health and medicine questions that test advanced conceptual understanding and clinical or scientific reasoning.
- Ensure questions are unambiguous, self-contained, and precisely defined.




- Include all information necessary for solving each question within the problem statement.
- Classify questions as:
- Medium: Introductory undergraduate level
- Hard: Advanced undergraduate level
- Expert: Postgraduate level and above
- Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
- Develop clear, step-by-step solutions explaining the reasoning behind the correct answer.
- Provide 1–5 academic references per question from reputable sources, including peer-reviewed journals and clinical guidelines.
- Review existing questions for clarity, completeness, precision, accuracy, and solvability.
- Identify and justify necessary edits during verification tasks.
- Maintain high standards of scientific accuracy, academic rigor, and question quality.

Required Qualifications

- MD, DO, PhD, or doctoral-level training in Medicine, Biomedical Sciences, Public Health, or a closely related field.
- Strong command of graduate-level medical knowledge and clinical reasoning.
- Demonstrated understanding of biomedical research methodology.
- Excellent written English with the ability to communicate complex medical concepts clearly and concisely.
- Robust attention to detail and ability to evaluate academic content critically.

Preferred Qualifications





- Master's degree combined with exceptional depth in a specific medical or health science subdomain.
- Board certification or equivalent professional specialization.
- Clinical experience in a relevant health or medical discipline.
- Research experience or peer-reviewed publications in health sciences or medicine.
- Experience creating, reviewing, or evaluating academic assessment content.
- Familiarity with evidence-based medicine, clinical guidelines, and biomedical literature.

Key Areas of Expertise

- Clinical Medicine & Surgery
- Medical Imaging & Diagnostics
- Pharmacovigilance
- Healthcare Management & Economics
- Rehabilitation & Allied Health
- Clinical Reasoning
- Biomedical Research
- Medical Education & Assessment
- Evidence-Based Medicine
- Academic Question Development
- Scientific Literature Evaluation

Compensation & Engagement

- Compensation: $94–$119/hour
- Commitment: 10+ hours per week
- Work Arrangement: Fully remote
- Schedule: Asynchronous
- Engagement: AI research and benchmark development

Eligibility Candidates should have advanced academic or professional expertise in medicine, biomedical sciences, public health, or a closely related discipline and be able to independently produce or evaluate rigorous health and medicine assessment content.

Application Process

1. Submit your resume and complete the application form.
2. Participate in a 25-minute conversational interview covering your background, experience, and motivations.
3. Receive follow-up within a few days regarding next steps and onboarding.
4. Begin contributing to the AI benchmark following successful onboarding.

📌 Medical & Healthcare Specialist (Remote | ) (Canada)
🏢 Synthires
📍 Canada