TY - JOUR
T1 - Does the think-aloud protocol reflect thinking? Exploring functional neuroimaging differences with thinking (answering multiple choice questions) versus thinking aloud
AU - Durning, Steven J.
AU - Artino, Anthony R.
AU - Beckman, Thomas J.
AU - Graner, John
AU - Van Der Vleuten, Cees
AU - Holmboe, Eric
AU - Schuwirth, Lambert
N1 - Funding Information:
This study was supported by grant funding from the American Board of Internal Medicine Foundation.
PY - 2013/9
Y1 - 2013/9
N2 - Background: Whether the think-aloud protocol is a valid measure of thinking remains uncertain. Therefore, we used functional magnetic resonance imaging (fMRI) to investigate potential functional neuroanatomic differences between thinking (answering multiple-choice questions in real time) versus thinking aloud (on review of items). Methods: Board-certified internal medicine physicians underwent formal think-aloud training. Next, they answered validated multiple-choice questions in an fMRI scanner while both answering (thinking) and thinking aloud about the questions, and we compared fMRI images obtained during both periods. Results: Seventeen physicians (15 men and 2 women) participated in the study. Mean physician age was 39.5+7 (range: 32-51 years). The mean number of correct responses was 18.5/32 questions (range: 15-25). Statistically significant differences were found between answering (thinking) and thinking aloud in the following regions: motor cortex, bilateral prefrontal cortex, bilateral cerebellum, and the basal ganglia (p<0.01). Discussion: We identified significant differences between answering and thinking aloud within the motor cortex, prefrontal cortex, cerebellum, and basal ganglia. These differences were by degree (more focal activation in these areas with thinking aloud as opposed to answering). Prefrontal cortex and cerebellum activity was attributable to working memory. Basal ganglia activity was attributed to the reward of answering a question. The identified neuroimaging differences between answering and thinking aloud were expected based on existing theory and research in other fields. These findings add evidence to the notion that the think-aloud protocol is a reasonable measure of thinking.
AB - Background: Whether the think-aloud protocol is a valid measure of thinking remains uncertain. Therefore, we used functional magnetic resonance imaging (fMRI) to investigate potential functional neuroanatomic differences between thinking (answering multiple-choice questions in real time) versus thinking aloud (on review of items). Methods: Board-certified internal medicine physicians underwent formal think-aloud training. Next, they answered validated multiple-choice questions in an fMRI scanner while both answering (thinking) and thinking aloud about the questions, and we compared fMRI images obtained during both periods. Results: Seventeen physicians (15 men and 2 women) participated in the study. Mean physician age was 39.5+7 (range: 32-51 years). The mean number of correct responses was 18.5/32 questions (range: 15-25). Statistically significant differences were found between answering (thinking) and thinking aloud in the following regions: motor cortex, bilateral prefrontal cortex, bilateral cerebellum, and the basal ganglia (p<0.01). Discussion: We identified significant differences between answering and thinking aloud within the motor cortex, prefrontal cortex, cerebellum, and basal ganglia. These differences were by degree (more focal activation in these areas with thinking aloud as opposed to answering). Prefrontal cortex and cerebellum activity was attributable to working memory. Basal ganglia activity was attributed to the reward of answering a question. The identified neuroimaging differences between answering and thinking aloud were expected based on existing theory and research in other fields. These findings add evidence to the notion that the think-aloud protocol is a reasonable measure of thinking.
UR - http://www.scopus.com/inward/record.url?scp=84883036204&partnerID=8YFLogxK
U2 - 10.3109/0142159X.2013.801938
DO - 10.3109/0142159X.2013.801938
M3 - Article
C2 - 23805999
AN - SCOPUS:84883036204
SN - 0142-159X
VL - 35
SP - 720
EP - 726
JO - Medical Teacher
JF - Medical Teacher
IS - 9
ER -