Improved Medical Student Satisfaction and Test Performance With a Simulation-Based Emergency Medicine Curriculum

A Randomized Controlled Trial

Raymond P. Ten Eyck, Matthew C Tews, John M. Ballester

Research output: Contribution to journalArticle

42 Citations (Scopus)

Abstract

Study objective: We determine the effect of a simulation-based curriculum on fourth-year medical student test performance and satisfaction during an emergency medicine clerkship. Methods: This was a randomized controlled study using a crossover design for curriculum format and an anonymous end-of-rotation satisfaction survey. Students were randomized into 2 groups. One group started the rotation with simulation and the other with group discussion. Midrotation, they each crossed over to the opposite format. All students subsequently completed the same multiple choice examination. We assessed paired samples of the number of questions missed for material taught in each format. Students rated satisfaction with a 5-point Likert scale framed as attitude toward simulation compared with group discussion. Scores ranged from 5, signifying strong agreement with a statement, to 1, signifying strong disagreement. Results: Ninety students (99%) completed the multiple choice test. Significantly fewer questions were missed for material presented in simulation format compared with group discussion, with a mean difference per student of 0.7 (95% confidence interval [CI] 0.3 to 1.0; P=.006). This corresponds to mean scores of 89.8% for simulation and 86.4% for group discussion. Eighty-eight (97%) students completed the satisfaction survey. Students rated simulation as more stressful (mean 4.1; 95% CI 3.9 to 4.3), but also more enjoyable (mean 4.5; 95% CI 4.3 to 4.6), more stimulating (mean 4.7; 95% CI 4.5 to 4.8), and closer to the actual clinical setting (mean 4.6; 95% CI 4.4 to 4.7) compared with group discussion. Conclusion: A simulation-based curriculum yielded measurable benefits. Students demonstrated a small improvement in learning and were more satisfied with the simulation-based curriculum compared with group discussion.

Original languageEnglish (US)
Pages (from-to)684-691
Number of pages8
JournalAnnals of Emergency Medicine
Volume54
Issue number5
DOIs
StatePublished - Jan 1 2009
Externally publishedYes

Fingerprint

Emergency Medicine
Medical Students
Curriculum
Randomized Controlled Trials
Students
Confidence Intervals
Cross-Over Studies
Learning

ASJC Scopus subject areas

  • Emergency Medicine

Cite this

Improved Medical Student Satisfaction and Test Performance With a Simulation-Based Emergency Medicine Curriculum : A Randomized Controlled Trial. / Ten Eyck, Raymond P.; Tews, Matthew C; Ballester, John M.

In: Annals of Emergency Medicine, Vol. 54, No. 5, 01.01.2009, p. 684-691.

Research output: Contribution to journalArticle

@article{e2fb8616d21e49fd89e580ab106cdb7e,
title = "Improved Medical Student Satisfaction and Test Performance With a Simulation-Based Emergency Medicine Curriculum: A Randomized Controlled Trial",
abstract = "Study objective: We determine the effect of a simulation-based curriculum on fourth-year medical student test performance and satisfaction during an emergency medicine clerkship. Methods: This was a randomized controlled study using a crossover design for curriculum format and an anonymous end-of-rotation satisfaction survey. Students were randomized into 2 groups. One group started the rotation with simulation and the other with group discussion. Midrotation, they each crossed over to the opposite format. All students subsequently completed the same multiple choice examination. We assessed paired samples of the number of questions missed for material taught in each format. Students rated satisfaction with a 5-point Likert scale framed as attitude toward simulation compared with group discussion. Scores ranged from 5, signifying strong agreement with a statement, to 1, signifying strong disagreement. Results: Ninety students (99{\%}) completed the multiple choice test. Significantly fewer questions were missed for material presented in simulation format compared with group discussion, with a mean difference per student of 0.7 (95{\%} confidence interval [CI] 0.3 to 1.0; P=.006). This corresponds to mean scores of 89.8{\%} for simulation and 86.4{\%} for group discussion. Eighty-eight (97{\%}) students completed the satisfaction survey. Students rated simulation as more stressful (mean 4.1; 95{\%} CI 3.9 to 4.3), but also more enjoyable (mean 4.5; 95{\%} CI 4.3 to 4.6), more stimulating (mean 4.7; 95{\%} CI 4.5 to 4.8), and closer to the actual clinical setting (mean 4.6; 95{\%} CI 4.4 to 4.7) compared with group discussion. Conclusion: A simulation-based curriculum yielded measurable benefits. Students demonstrated a small improvement in learning and were more satisfied with the simulation-based curriculum compared with group discussion.",
author = "{Ten Eyck}, {Raymond P.} and Tews, {Matthew C} and Ballester, {John M.}",
year = "2009",
month = "1",
day = "1",
doi = "10.1016/j.annemergmed.2009.03.025",
language = "English (US)",
volume = "54",
pages = "684--691",
journal = "Annals of Emergency Medicine",
issn = "0196-0644",
publisher = "Mosby Inc.",
number = "5",

}

TY - JOUR

T1 - Improved Medical Student Satisfaction and Test Performance With a Simulation-Based Emergency Medicine Curriculum

T2 - A Randomized Controlled Trial

AU - Ten Eyck, Raymond P.

AU - Tews, Matthew C

AU - Ballester, John M.

PY - 2009/1/1

Y1 - 2009/1/1

N2 - Study objective: We determine the effect of a simulation-based curriculum on fourth-year medical student test performance and satisfaction during an emergency medicine clerkship. Methods: This was a randomized controlled study using a crossover design for curriculum format and an anonymous end-of-rotation satisfaction survey. Students were randomized into 2 groups. One group started the rotation with simulation and the other with group discussion. Midrotation, they each crossed over to the opposite format. All students subsequently completed the same multiple choice examination. We assessed paired samples of the number of questions missed for material taught in each format. Students rated satisfaction with a 5-point Likert scale framed as attitude toward simulation compared with group discussion. Scores ranged from 5, signifying strong agreement with a statement, to 1, signifying strong disagreement. Results: Ninety students (99%) completed the multiple choice test. Significantly fewer questions were missed for material presented in simulation format compared with group discussion, with a mean difference per student of 0.7 (95% confidence interval [CI] 0.3 to 1.0; P=.006). This corresponds to mean scores of 89.8% for simulation and 86.4% for group discussion. Eighty-eight (97%) students completed the satisfaction survey. Students rated simulation as more stressful (mean 4.1; 95% CI 3.9 to 4.3), but also more enjoyable (mean 4.5; 95% CI 4.3 to 4.6), more stimulating (mean 4.7; 95% CI 4.5 to 4.8), and closer to the actual clinical setting (mean 4.6; 95% CI 4.4 to 4.7) compared with group discussion. Conclusion: A simulation-based curriculum yielded measurable benefits. Students demonstrated a small improvement in learning and were more satisfied with the simulation-based curriculum compared with group discussion.

AB - Study objective: We determine the effect of a simulation-based curriculum on fourth-year medical student test performance and satisfaction during an emergency medicine clerkship. Methods: This was a randomized controlled study using a crossover design for curriculum format and an anonymous end-of-rotation satisfaction survey. Students were randomized into 2 groups. One group started the rotation with simulation and the other with group discussion. Midrotation, they each crossed over to the opposite format. All students subsequently completed the same multiple choice examination. We assessed paired samples of the number of questions missed for material taught in each format. Students rated satisfaction with a 5-point Likert scale framed as attitude toward simulation compared with group discussion. Scores ranged from 5, signifying strong agreement with a statement, to 1, signifying strong disagreement. Results: Ninety students (99%) completed the multiple choice test. Significantly fewer questions were missed for material presented in simulation format compared with group discussion, with a mean difference per student of 0.7 (95% confidence interval [CI] 0.3 to 1.0; P=.006). This corresponds to mean scores of 89.8% for simulation and 86.4% for group discussion. Eighty-eight (97%) students completed the satisfaction survey. Students rated simulation as more stressful (mean 4.1; 95% CI 3.9 to 4.3), but also more enjoyable (mean 4.5; 95% CI 4.3 to 4.6), more stimulating (mean 4.7; 95% CI 4.5 to 4.8), and closer to the actual clinical setting (mean 4.6; 95% CI 4.4 to 4.7) compared with group discussion. Conclusion: A simulation-based curriculum yielded measurable benefits. Students demonstrated a small improvement in learning and were more satisfied with the simulation-based curriculum compared with group discussion.

UR - http://www.scopus.com/inward/record.url?scp=70350051477&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350051477&partnerID=8YFLogxK

U2 - 10.1016/j.annemergmed.2009.03.025

DO - 10.1016/j.annemergmed.2009.03.025

M3 - Article

VL - 54

SP - 684

EP - 691

JO - Annals of Emergency Medicine

JF - Annals of Emergency Medicine

SN - 0196-0644

IS - 5

ER -