TY - JOUR
T1 - Dynamic Measurement in Health Professions Education
T2 - Rationale, Application, and Possibilities
AU - Dumas, Denis
AU - McNeish, Daniel
AU - Schreiber-Gregory, Deanna
AU - Durning, Steven J.
AU - Torre, Dario M.
N1 - Publisher Copyright:
Copyright © 2019 by the Association of American Medical Colleges.
PY - 2019/9/1
Y1 - 2019/9/1
N2 - Dynamic measurement modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate individual students' growth in measured skills over the course of an educational program (i.e., growth scores). DMM represents a more formal way of assessing learning progress across the health professions education continuum. In this article, the authors provide justification for this approach in health professions education and demonstrate its proof-of-concept use with three time points of United States Medical Licensing Examination Step exams to generate growth scores for 454 current and recent medical learners. The authors demonstrate that learners vary substantially on their growth scores, and those growth scores exhibit psychometric reliability. In addition, growth scores significantly and positively correlated with indicators of medical learner readiness (e.g., undergraduate grade point average and Medical College Admission Test scores). These growth scores were also capable of significantly and positively correlating with future ratings of clinical competencies during internship as assessed through a survey sent to their program directors at the end of the first postgraduate year (e.g., patient care, interpersonal skills). These preliminary findings of reliability and validity for DMM growth scores provide initial evidence for further investigation into the suitability of a dynamic measurement paradigm in health professions education.
AB - Dynamic measurement modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate individual students' growth in measured skills over the course of an educational program (i.e., growth scores). DMM represents a more formal way of assessing learning progress across the health professions education continuum. In this article, the authors provide justification for this approach in health professions education and demonstrate its proof-of-concept use with three time points of United States Medical Licensing Examination Step exams to generate growth scores for 454 current and recent medical learners. The authors demonstrate that learners vary substantially on their growth scores, and those growth scores exhibit psychometric reliability. In addition, growth scores significantly and positively correlated with indicators of medical learner readiness (e.g., undergraduate grade point average and Medical College Admission Test scores). These growth scores were also capable of significantly and positively correlating with future ratings of clinical competencies during internship as assessed through a survey sent to their program directors at the end of the first postgraduate year (e.g., patient care, interpersonal skills). These preliminary findings of reliability and validity for DMM growth scores provide initial evidence for further investigation into the suitability of a dynamic measurement paradigm in health professions education.
UR - http://www.scopus.com/inward/record.url?scp=85071608711&partnerID=8YFLogxK
U2 - 10.1097/ACM.0000000000002729
DO - 10.1097/ACM.0000000000002729
M3 - Article
C2 - 31460924
AN - SCOPUS:85071608711
SN - 1040-2446
VL - 94
SP - 1323
EP - 1328
JO - Academic Medicine
JF - Academic Medicine
IS - 9
ER -