Job Title

Statistics and Psychometrics Specialist

Employer

The McLaughlin Centre for Evaluation (TMCE) – Exams Quality Assurance (EQA)

Job Type

Permanent

About

Today, the Royal College has over 55,000 members, and the vision remains to advance the learning for specialist physicians to deliver the best health care for all. The Royal College partners and collaborates to lead the evolution of specialty medical education and standards; support specialist physicians, learners and teams to continuously improve; and advocate for excellence in specialty medicine by supporting innovation, well-being, equity and person-centered care. We are a national, nonprofit organization established in 1929 by a special Act of Parliament to oversee the medical education of specialists in Canada.

Role Overview

Reporting to the Manager, Exam Quality and Analytics, the Statistics and Psychometrics Specialist supports the assessments of specialty physicians by providing advice that guides and informs the direction of exam development, exam quality improvement, and assessment practices to ensure fair and valid assessments.

The Statistics and Psychometrics Specialist contributes to decision making by collecting, analyzing, and presenting data. Working in a team environment, the Statistics and Psychometrics Specialist is responsible for the accuracy and consistency of exam data, provides statistical analysis, performs quality assurance, and research studies on examination data and information for specialty and sub-specialty exams. The Statistics and Psychometrics Specialist conducts and publishes research related to Royal College examinations and assessment activities.

Typical Day





- Perform statistical and psychometric analysis of examination data and conduct quality assurance studies to ensure the integrity and quality of the data.
- Produce psychometric reports that present examination result information so that the information may be consumed by candidates, board/committee members and/or Royal College leadership.
- Guide and inform the direction of exam development, exam quality improvements, and assessment practices of the Royal College to ensure fair and valid exams.
- Contribute to decision making of exam design and results to ensure the reliability and quality of the exams.
- Support internal and external stakeholders in the development of fair and valid exams by guiding the stakeholders in applying best practices and Royal College policies.

Qualifications

- Level of education, training, and experience equivalent to a master’s degree in statistics, mathematics, education, or psychology.
- Six years of experience performing statistical analysis.
- Advanced knowledge of parametric/non-parametric and regression techniques; of one or more statistical software tools (e.g., SAS, SPSS, Stata, R); as well as experience and/or familiarity with relational database systems (e.g., SQL, MS Access).
- Experience in data management, databases, and analytical skills, with knowledge of statistical methodology.




- Exceptional attention to detail and accuracy in handling quantitative data and information.
- Experience working with, interpreting, and communicating data results.
- Ability to communicate complex ideas in simple terminology and present to different audiences.
- Advanced knowledge of Microsoft Office applications (Excel, Word, Outlook, etc.).

EEO Statement

The Royal College invites applications from all qualified applicants. The Royal College is strongly committed to employment equity and diversity in the workplace and encourages applications from Black, racialized/visible minorities, Indigenous/Aboriginal people, women, persons with disabilities, and 2SLGBTQQIA+ persons.

Work Arrangement

The Royal College supports a hybrid work setting which includes a combination of working both onsite in Ottawa and from home.

Additional Notes

Please note that the job advertisement will no longer be available once the position has closed.

Salary

Band 7 - Salary ranges from $78,548.00 to $98,236.00

Titre du poste

Spécialiste des statistiques et de la psychométrie

Centre d’évaluation

Centre d’évaluation McLaughlin (CEM) – Assurance de la qualité des examens

Type de contrat

Permanent

À propos

Le Collège royal des médecins et chirurgiens du Canada compte aujourd’hui plus de 55 000 membres, mais sa vision reste la même : faire progresser l’apprentissage des médecins spécialistes pour offrir les meilleurs soins de santé à toute la population. De façon concertée et en partenariat, le Collège royal dirige l’évolution de la formation médicale spécialisée et des normes dans ce dom

📌 Statistics and Psychometrics Specialist (Ottawa)
🏢 Royal College of Physicians and Surgeons of Canada
📍 Ottawa