Research reports

The Medical Council of Canada’s internal researchers often publish technical reports, collaborate with external researchers on technical reports, or fund research into specific directed areas. Below is the list of technical reports arising from these types of studies:

Bahry, L., Hambleton, R.K., Gotzmann, A., De Champlain, A. & Roy, M. (2012). National Assessment Collaboration Standard Setting Study Report.

Bartman, I., Roy, M. & Smee, S. (2011). Catching the Hawks and Doves: A Method for Identifying Extreme Examiners on Objective Structured Clinical Examinations.

Bartman, I., Smee, S.M. & Roy, M. (2013). A method for identifying extreme OSCE examiners. Clinical Teacher, 10(1), 27-31.

Breithaupt, K. (2011). Medical Licensure Testing: White Paper for the Assessment Review Task Force of the Medical Council of Canada.

Breithaupt, K. & Hare D.R. (2011). Test Assembly and Delivery Models for a National Examination of Medical Knowledge: Optimal Form Quality and Item Usage from a Modular Design.

De Champlain, A.F., Boulais (2011). Assessing the Underlying Structure of the Medical Council of Canada’s Qualifying Examination Part I Clinical Decision Making Cases: A Comparison of Exploratory and Confirmatory Factor Analysis Models.

De Champlain, A.F., Boulais, A.-P. & Dallas, A. (2012). Calibrating the Medical Council of Canada’s Qualifying Part I Examination Using an Integrated Item Response Theory Framework: A Comparison of Models and Calibration Designs.

De Champlain, A., Gotzmann, A., Qin, S. (2016). Assessing the Reliability of Performance Assessing Scores: Some Considerations in Selecting an Appropriate Framework.

De Champlain, A., Streefkerk, C., Tian, F., Roy, M., Qin, S., Brailovsky, C., Rainsberry, P., Allen, T., Slade, S. (2014). Predicting Family Medicine Specialty Certification Status Using Standardized Measures for a Sample of International Medical Graduates Engaged in a Practice-Ready Assessment Pathway to Provisional Licensure.

Eva, K.W., Bordage, G., Campbell, C., Galbraith, R., Ginsburg, S., Holmboe, E., Regehr, G. (2015). Towards a program of assessment for health professionals: from training into practice. Adv Health Sci Educ Theory Pract.

Gierl, M. & Lai, H. (2011). Using Statistical Measures of Differential Item Functioning to Identify Items that Elicit Group Differences on the Medical Council of Canada Qualifying Exam Part I.

Gierl, M. & Lai, H. (2012). Methods for Creating and Evaluating the Item Model Structure Used In Automatic Item Generation.

Gierl, M., Lai, H., & Li, J. (2011). Evaluating the Performance of CATSIB in a Multi-Stage Adaptive Testing Environment.

Gierl, M.J., Lai, H., Pugh, D., Touchie, C., Boulais, A.P., De Champlain, A.F. (2016). Evaluating the Psychometric Characteristics of Generated Multiple-Choice Test Items.

Gong, J. (2012). Detection of Differential Test Functioning (DTF) and Differential Item Functioning (DIF) in MCCQE Part II Using Logistic Models.

Gotzmann, A., De Champlain, A., Roy., M., Brailovsky, C., Smee, S., de Vries, I. (2014). Setting a Common Performance Standard for Two Candidate Groups across Different Medical Licensing Examination Forms: A Comparison of Methods.

Gotzmann, A., De Champlain, A., Homayra, F., Fotheringham, Al, de Vries, I., Forgie, M., Pugh, D. (2016). Cheating in OSCEs: The impact of Simulated Security Breaches on OSCE Performance.

Gotzmann, A., De Champlain, A., Touchie, C., Boulet, J. (2013) National Survey of the Physicians, Pharmacists, Nurses, and Public in Canada: 2013.

Halman, S., Dudek, N., Wood, T.J., Pugh, D., Touchie, C., McAleer, S., Humphrey-Murto, S. (2016). Direct Observation of Clinical Skills Feedback Scale: Development and Validity Evidence.

Hambleton, R.K., De Champlain, A. (2013). Recommending a Passing Score on the National Assessment Collaboration (NAC) Examination: Procedures and Results.

Lai, H. & Gierl, M. (2012). Design Principles Required for Skills-Based Calibrated Item Generation.

Lai, H., Gierl, M.J., Touchie, C., Pugh, D., Boulais, A.P., De Champlain, A.F. (2016). Using Automatic Item Generation to Improve the Quality of MCQ Distractors. 

Li, J., Gierl, M.J., Lai, H. & Roussos, L. A Modified CATSIB Procedure for Detecting Differential Item Function on Computer-Based Tests.

Lockyer, J., Carracio, C., Chan, M.K., Hart, D., Smee, S., Touchie, C., Holmboe, E., Frank, J.F. for the international CBME Collaborators. (2017). Core principles of assessment in competency-based medical education.

Medical Council of Canada. (2016).  MCCQE Part I Annual Technical Report 2016.

Medical Council of Canada. (2016). MCCQE Part II Annual Technical Report 2016.

Medical Council of Canada. (2016). NAC Annual Technical Report 2016.

Psychometrics and Assessment Services, MCC. (2017). Technical Report on the Standard Setting Exercise for the Medical Council of Canada Evaluating Examination.

Psychometrics and Assessment Services, MCC. (2015). Technical Report on the Standard Setting Exercise for the Medical Council of Canada Qualifying Examination Part I.

Psychometrics and Assessment Services, MCC. (2015). Technical Report on the Standard Setting Exercise for the Medical Council of Canada Qualifying Examination Part II.

Roy, M., Wojcik, J., Bartman, Il, Smee, S. (2016). Augmenting Physician Examiner (PE) Scoring in OSCEs: A Pilot for Including the Standardized Patient.

Sandilands, D., Gotzmann, A., Roy, M., Zumbo, B. D., De Champlain, A. F. (2014). Weighting checklist items and station components on a large-scale OSCE: Is it worth the effort? Medical Teacher, 36(7): 585-590.

Sebok, S.S. (2015). Examiners and content and site: Oh My! A national organization.

Soto, A.C. Practice Analysis Studies: Literature Review of Definitions, Concepts, Features, and Methodologies.

Tamblyn, R., Abrahamowicz, M., Bartlett, G., Winslade, N., Jacques, A., Klass, D., Wenghofer, E., Smee, S., Dauphinee, D., Blackmore, D., Bartman, I., Buckeridge, D. & Hanley, J. (2009). The Quebec-Ontario Follow-up Study of the Association between Scores Achieved on the MCCQE Part II Examination and Performance in Clinical Practice.

Touchie, C. (2013). Report of the Incidence and Prevalence of Diseases and Other Health Related Issues in Canada: A Study for the MCC Blueprint Project.

Touchie, C., ten Cate O. (2016). The promise, perils, problems and progress of competency-based education. Medical Education Journal; 50 (1):93-100.

Wood, T.J., Chan, J., Humphrey-Murto, S., Pugh, D., Touchie, C. (2016). The influences of first impression ratings in an OSCE station.

Wood, T.J., Roy, M., McConnell, M.M. & Breithaupt, K. (2011). Evidence for the Validity of a Clinical Skill Assessment.