About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering tale solutions. With a solid background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview We are looking for experienced physicians and surgeons to support the training and evaluation of advanced AI systems. The role focuses on creating and reviewing complex clinical scenarios that test AI capabilities in diagnostic reasoning, differential diagnosis, treatment planning, guideline interpretation, and clinical risk management. This opportunity is best suited to senior clinicians with substantial post-residency practice who remain current with modern standards of care and can translate complex medical judgment into structured, technically precise evaluation tasks.

CONTRACT: Short-term contractor assignment, 9 weeks COMMITMENT: At least 4 hours per day and up to 40 hours per week, including 4 hours of PST overlap LOCATIONS: Remote PROCESS: 60 min Online test about Clinical & Health (MSQ questions) NOTES: Candidates must have actively practiced within the last 3 years and hold an MD, DO, or regionally equivalent medical qualification with active or recent specialty board certification.

Responsibilities Create high-difficulty clinical tasks based on realistic physician and surgical scenarios





Develop gold-standard solutions covering diagnosis, workup, treatment planning, and clinical decision-making

Build cases involving complex histories, laboratory results, imaging, symptoms, and competing diagnostic hypotheses

Evaluate AI-generated clinical outputs for accuracy, completeness, safety, and adherence to current standards

Create scenarios involving differential diagnosis, treatment pathways, procedural decisions, and risk management

Apply established evaluation rubrics and grading standards consistently

Review and refine patient charts, clinical management plans, consultation notes, and treatment recommendations

Incorporate calibration feedback and revise task designs as required

Maintain strong alignment with current medical guidelines and patient-safety principles

Escalate genuine clinical edge cases or ambiguous evaluation criteria to the functional expert lead Requirements MD, DO, or equivalent medical qualification with recent board certification

8-15 years of post-residency clinical practice

Active clinical practice within the last 3 years

Expertise in complex diagnostic reasoning and treatment planning

Proven track record of high-level medical deliverables

Exceptional analytical thinking and attention to detail

Superior written communication skills

Ability to work independently in a fast-paced environment

📌 Senior Physician / Surgeon Expert (AI Clinical Evaluation) (Canada)
🏢 Gramian Consulting
📍 Canada