TY - JOUR
T1 - The feasibility and acceptability of implementing formal evaluation sessions and using descriptive vocabulary to assess student performance on a clinical clerkship.
AU - Battistone, Michael J.
AU - Milne, Caroline
AU - Sande, Merle A.
AU - Pangaro, Louis N.
AU - Hemmer, Paul A.
AU - Shomaker, T. Samuel
N1 - Funding Information:
This research was sponsored in part by a grant from the Western Institute for Biomedical Research. The opinions expressed in this paper are solely those of the authors and do not necessarily reflect the opinions of the Department of Defense, the United States Air Force, the Veterans Administration, or other federal agencies. Correspondence may be sent to Michael J. Battistone, M.D., Assistant Professor of Medicine, Clerkship Director, Internal Medicine, The University of Utah, 50 North Medical Drive, Salt Lake City, UT 84132, USA. E-mail: [email protected]
PY - 2002
Y1 - 2002
N2 - BACKGROUND: A systematized approach to descriptive evaluation of clinical performance using a vocabulary of global descriptors in the setting of formal evaluation and feedback sessions has been shown to be reliable and valid. The feasibility of this method beyond the institution at which it was developed has not been studied. PURPOSE: To determine the feasibility and acceptability of implementing formal evaluation and feedback sessions, using a vocabulary of global descriptors, in a third-year core clinical clerkship. METHODS: In 1997, the University of Utah internal medicine clerkship introduced an evaluation method in which student performance was discussed at formal sessions, using a taxonomy of global terms describing progressive development from "reporter" to "interpreter" to "manager/educator" (R-I-M-E). The sessions were face-to-face meetings between the clinical teachers and a clerkship director, at three-week intervals through the twelve-week clerkship at the inpatient teaching sites. Following the evaluation session students met individually with the clerkship director for feedback. To determine feasibility, the authors estimated the time and resources necessary to administer the system and recorded actual teacher attendance over 2 academic years (1997-99). Anonymous surveys, using a four-point, Likert-type scale, were used to determine acceptance of the method by faculty, residents, and students. RESULTS: Attendance was high for residents (79%) and faculty (72%). Mean survey responses from residents and faculty rated the descriptive system "more valid" than the previous method. A majority of the students rated the method as either "helpful" (30%) or "very helpful" (50%). Time requirement for eight to ten students at each teaching site, for evaluation and feedback sessions was one-half day per week of the clerkship director, every three weeks. CONCLUSION: Our experience establishes the feasibility of implementing this system of formal evaluation and feedback, using descriptive vocabulary, beyond the institution at which it was developed. Students, residents, and faculty endorsed this evaluation system and the survey results suggest substantial utility and face validity.
AB - BACKGROUND: A systematized approach to descriptive evaluation of clinical performance using a vocabulary of global descriptors in the setting of formal evaluation and feedback sessions has been shown to be reliable and valid. The feasibility of this method beyond the institution at which it was developed has not been studied. PURPOSE: To determine the feasibility and acceptability of implementing formal evaluation and feedback sessions, using a vocabulary of global descriptors, in a third-year core clinical clerkship. METHODS: In 1997, the University of Utah internal medicine clerkship introduced an evaluation method in which student performance was discussed at formal sessions, using a taxonomy of global terms describing progressive development from "reporter" to "interpreter" to "manager/educator" (R-I-M-E). The sessions were face-to-face meetings between the clinical teachers and a clerkship director, at three-week intervals through the twelve-week clerkship at the inpatient teaching sites. Following the evaluation session students met individually with the clerkship director for feedback. To determine feasibility, the authors estimated the time and resources necessary to administer the system and recorded actual teacher attendance over 2 academic years (1997-99). Anonymous surveys, using a four-point, Likert-type scale, were used to determine acceptance of the method by faculty, residents, and students. RESULTS: Attendance was high for residents (79%) and faculty (72%). Mean survey responses from residents and faculty rated the descriptive system "more valid" than the previous method. A majority of the students rated the method as either "helpful" (30%) or "very helpful" (50%). Time requirement for eight to ten students at each teaching site, for evaluation and feedback sessions was one-half day per week of the clerkship director, every three weeks. CONCLUSION: Our experience establishes the feasibility of implementing this system of formal evaluation and feedback, using descriptive vocabulary, beyond the institution at which it was developed. Students, residents, and faculty endorsed this evaluation system and the survey results suggest substantial utility and face validity.
UR - http://www.scopus.com/inward/record.url?scp=0036885830&partnerID=8YFLogxK
U2 - 10.1207/S15328015TLM1401_3
DO - 10.1207/S15328015TLM1401_3
M3 - Article
C2 - 11865750
AN - SCOPUS:0036885830
SN - 1040-1334
VL - 14
SP - 5
EP - 10
JO - Teaching and Learning in Medicine
JF - Teaching and Learning in Medicine
IS - 1
ER -