TY - JOUR
T1 - Modeling Performance of Open Surgical Cases
AU - Azari, David P.
AU - Frasier, Lane L.
AU - Miller, Brady L.
AU - Pavuluri Quamme, Sudha R.
AU - Le, Brian V.
AU - Greenberg, Caprice C.
AU - Radwin, Robert G.
N1 - Publisher Copyright:
Copyright © 2021 Society for Simulation in Healthcare.
PY - 2021/12/1
Y1 - 2021/12/1
N2 - INTRODUCTION: Previous efforts used digital video to develop computer-generated assessments of surgical hand motion economy and fluidity of motion. This study tests how well previously trained assessment models match expert ratings of suturing and tying video clips recorded in a new operating room (OR) setting. METHODS: Enabled through computer vision of the hands, this study tests the applicability of assessments born out of benchtop simulations to in vivo suturing and tying tasks recorded in the OR. RESULTS: Compared with expert ratings, computer-generated assessments for fluidity of motion (slope = 0.83, intercept = 1.77, R2 = 0.55) performed better than motion economy (slope = 0.73, intercept = 2.04, R2 = 0.49), although 85% of ratings for both models were within ±2 of the expert response. Neither assessment performed as well in the OR as they did on the training data. Assessments were sensitive to changing hand postures, dropped ligatures, and poor tissue contact-features typically missing from training data. Computer-generated assessment of OR tasks was contingent on a clear, consistent view of both surgeon's hands. CONCLUSIONS: Computer-generated assessment may help provide formative feedback during deliberate practice, albeit with greater variability in the OR compared with benchtop simulations. Future work will benefit from expanded available bimanual video records.
AB - INTRODUCTION: Previous efforts used digital video to develop computer-generated assessments of surgical hand motion economy and fluidity of motion. This study tests how well previously trained assessment models match expert ratings of suturing and tying video clips recorded in a new operating room (OR) setting. METHODS: Enabled through computer vision of the hands, this study tests the applicability of assessments born out of benchtop simulations to in vivo suturing and tying tasks recorded in the OR. RESULTS: Compared with expert ratings, computer-generated assessments for fluidity of motion (slope = 0.83, intercept = 1.77, R2 = 0.55) performed better than motion economy (slope = 0.73, intercept = 2.04, R2 = 0.49), although 85% of ratings for both models were within ±2 of the expert response. Neither assessment performed as well in the OR as they did on the training data. Assessments were sensitive to changing hand postures, dropped ligatures, and poor tissue contact-features typically missing from training data. Computer-generated assessment of OR tasks was contingent on a clear, consistent view of both surgeon's hands. CONCLUSIONS: Computer-generated assessment may help provide formative feedback during deliberate practice, albeit with greater variability in the OR compared with benchtop simulations. Future work will benefit from expanded available bimanual video records.
UR - http://www.scopus.com/inward/record.url?scp=85122450534&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85122450534&partnerID=8YFLogxK
U2 - 10.1097/SIH.0000000000000544
DO - 10.1097/SIH.0000000000000544
M3 - Article
C2 - 34860738
AN - SCOPUS:85122450534
VL - 16
SP - e188-e193
JO - Simulation in Healthcare
JF - Simulation in Healthcare
SN - 1559-2332
IS - 6
ER -