Training less-experienced faculty improves reliability of skills assessment in cardiac surgery

Xiaoying Lou, Richard Lee, Richard H. Feins, Daniel Enter, George L. Hicks, Edward D. Verrier, James I. Fann

Research output: Contribution to journalArticle

9 Scopus citations

Abstract

Objective Previous work has demonstrated high inter-rater reliability in the objective assessment of simulated anastomoses among experienced educators. We evaluated the inter-rater reliability of less-experienced educators and the impact of focused training with a video-embedded coronary anastomosis assessment tool.

Results All components of the assessment tool exhibited improvement in reliability, with 4 (bite, needle holder use, needle angles, and hand mechanics) improving the most from poor (ICC range, 0.09-0.48) to strong (ICC range, 0.80-0.90) agreement. After training, inter-rater reliabilities for composite scores improved from moderate (ICC, 0.76) to strong (ICC, 0.90) agreement, and for overall pass/fail ratings, from poor (kappa = 0.20) to moderate (kappa = 0.78) agreement.

Conclusions Focused, video-based anchor training facilitates greater inter-rater reliability in the objective assessment of simulated coronary anastomoses. Among raters with less teaching experience, such training may be needed before objective evaluation of technical skills.

Original languageEnglish (US)
Pages (from-to)2491-2496.e2
JournalJournal of Thoracic and Cardiovascular Surgery
Volume148
Issue number6
DOIs
StatePublished - Dec 1 2014
Externally publishedYes

ASJC Scopus subject areas

  • Surgery
  • Pulmonary and Respiratory Medicine
  • Cardiology and Cardiovascular Medicine

Fingerprint Dive into the research topics of 'Training less-experienced faculty improves reliability of skills assessment in cardiac surgery'. Together they form a unique fingerprint.

  • Cite this