Research reports

The Medical Council of Canada’s internal researchers often publish technical reports, collaborate with external researchers on technical reports, or fund research into specific directed areas. Below is the list of technical reports arising from these types of studies:

Bahry, L., Hambleton, R.K., Gotzmann, A., De Champlain, A. & Roy, M. (2012). National Assessment Collaboration Standard Setting Study Report.

Bartman, I., Kolen, M., Gong, J. & Smee, S.M. (2012). Equating the MCCQE Part II.

Bartman, I., Roy, M. & Smee, S. (2011). Catching the Hawks and Doves: A Method for Identifying Extreme Examiners on Objective Structured Clinical Examinations.

Bartman, I., Smee, S.M. & Roy, M. (2013). A method for identifying extreme OSCE examiners. Clinical Teacher, 10(1), 27-31.

Breithaupt, K. (2011). Medical Licensure Testing: White Paper for the Assessment Review Task Force of the Medical Council of Canada.

Breithaupt, K. & Hare D.R. (2012). Test Assembly and Delivery Models for a National Examination of Medical Knowledge.

Breithaupt, K. & Hare D.R. (2011). Test Assembly and Delivery Models for a National Examination of Medical Knowledge: Optimal Form Quality and Item Usage from a Modular Design.

Breithaupt, K., Pope, G. & Zumbo, B.D. Test Taker Experiences and Beliefs — A Case Study: Recent Examinees.

Breithaupt, K., Wood, T.J., Roy, M. & Zumbo, B.D. Unified Validity Framework: Evidence from an Objective Structured Clinical Exam (OSCE) for International Medical Graduates.

De Champlain, A.F., Boulais (2011). Assessing the Underlying Structure of the Medical Council of Canada’s Qualifying Examination Part I Clinical Decision Making Cases: A Comparison of Exploratory and Confirmatory Factor Analysis Models.

De Champlain, A.F., Boulais, A.-P. & Dallas, A. (2012). Calibrating the Medical Council of Canada’s Qualifying Part I Examination Using an Integrated Item Response Theory Framework: A Comparison of Models and Calibration Designs.

De Champlain, A., Gotzmann, A., Qin, S. (2016). Assessing the Reliability of Performance Assessing Scores: Some Considerations in Selecting an Appropriate Framework.

De Champlain, A., Streefkerk, C., Tian, F., Roy, M., Qin, S., Brailovsky, C., Rainsberry, P., Allen, T., Slade, S. (2014). Predicting Family Medicine Specialty Certification Status Using Standardized Measures for a Sample of International Medical Graduates Engaged in a Practice-Ready Assessment Pathway to Provisional Licensure.

Eva, K.W., Bordage, G., Campbell, C., Galbraith, R., Ginsburg, S., Holmboe, E., Regehr, G. (2015). Towards a program of assessment for health professionals: from training into practice. Adv Health Sci Educ Theory Pract.

Gierl, M. & Lai, H. (2011). Using Statistical Measures of Differential Item Functioning to Identify Items that Elicit Group Differences on the Medical Council of Canada Qualifying Exam Part I.

Gierl, M., Lai, H., & Li, J. (2011). Evaluating the Performance of CATSIB in a Multi-Stage Adaptive Testing Environment.

Gierl, M. & Lai, H. (2012). Methods for Creating and Evaluating the Item Model Structure Used In Automatic Item Generation.

Gong, J. (2012). Detection of Differential Test Functioning (DTF) and Differential Item Functioning (DIF) in MCCQE Part II Using Logistic Models.

Gotzmann, A., De Champlain, A., Roy., M., Brailovsky, C., Smee, S., de Vries, I. (2014). Setting a Common Performance Standard for Two Candidate Groups across Different Medical Licensing Examination Forms: A Comparison of Methods.

Gotzmann, A., De Champlain, A., Homayra, F., Fotheringham, Al, de Vries, I., Forgie, M., Pugh, D. (2016). Cheating in OSCEs: The impact of Simulated Security Breaches on OSCE Performance.

Gotzmann, A., De Champlain, A., Touchie, C., Boulet, J. (2013) National Survey of the Physicians, Pharmacists, Nurses, and Public in Canada: 2013.

Hambleton, R.K., De Champlain, A. (2013). Recommending a Passing Score on the National Assessment Collaboration (NAC) Examination: Procedures and Results.

Lai, H. & Gierl, M. (2012). Design Principles Required for Skills-Based Calibrated Item Generation.

Latifi, S.M.F., Gierl, M.J., Boulais, A.-P. (2013). Towards The Use of an Automated Scoring Framework at the Medical Council of Canada: An Exploratory Approach.

Li, J., Gierl, M.J., Lai, H. & Roussos, L. A Modified CATSIB Procedure for Detecting Differential Item Function on Computer-Based Tests.

Medical Council of Canada. (2016).  MCCQE Part I Annual Technical Report 2016.

Medical Council of Canada. (2016). MCCQE Part II Annual Technical Report 2016.

Medical Council of Canada. (2016). NAC Annual Technical Report 2016.

Psychometrics and Assessment Services, MCC. (2015). Technical Report on the Standard Setting Exercise for the Medical Council of Canada Qualifying Examination Part I.

Psychometrics and Assessment Services, MCC. (2015). Technical Report on the Standard Setting Exercise for the Medical Council of Canada Qualifying Examination Part II.

Roy, M., Wojcik, J., Bartman, Il, Smee, S. (2016). Augmenting Physician Examiner (PE) Scoring in OSCEs: A Pilot for Including the Standardized Patient.

Sandilands, D., Gotzmann, A., Roy, M., Zumbo, B. D., De Champlain, A. F. (2014). Weighting checklist items and station components on a large-scale OSCE: Is it worth the effort? Medical Teacher, 36(7): 585-590.

Sebok, S. (2013). Investigating Examiner and Site as Sources of Variation in the 2012 National Assessment Collaboration (NAC) Examination Using Hierarchical Linear Modeling (HLM).

Smee, S., Roy M. & Brailovsky, C. (2012). Validity Evidence For Integrating a Component of Two High-Stakes OSCE.

Soto, A.C. Practice Analysis Studies: Literature Review of Definitions, Concepts, Features, and Methodologies.

Tamblyn, R., Abrahamowicz, M., Bartlett, G., Winslade, N., Jacques, A., Klass, D., Wenghofer, E., Smee, S., Dauphinee, D., Blackmore, D., Bartman, I., Buckeridge, D. & Hanley, J. (2009). The Quebec-Ontario Follow-up Study of the Association between Scores Achieved on the MCCQE Part II Examination and Performance in Clinical Practice.

Touchie, C. (2013). Report of the Incidence and Prevalence of Diseases and Other Health Related Issues in Canada: A Study for the MCC Blueprint Project.

Touchie, C., ten Cate O. (2016). The promise, perils, problems and progress of competency-based education. Medical Education Journal; 50 (1):93-100.

Wood, T.J., Roy, M., McConnell, M.M. & Breithaupt, K. (2011). Evidence for the Validity of a Clinical Skill Assessment.