TY - JOUR
T1 - Development and assessment of the wisconsin surgical coaching rubric
AU - Vande Walle, Kara A.
AU - Quamme, Sudha R.Pavuluri
AU - Beasley, Heather L.
AU - Leverson, Glen E.
AU - Ghousseini, Hala N.
AU - Dombrowski, Janet C.
AU - Fry, Brian T.
AU - Dimick, Justin B.
AU - Wiegmann, Douglas A.
AU - Greenberg, Caprice C.
N1 - Funding Information:
Dr Vande Walle was supported by the NIH training grant T32 CA090217.
Funding Information:
Funding/Support: Funding for this work was provided by NIH/NIDDK grant R01 DK101423-01 and the Wisconsin Partnership Program Education and Research Committee grant 2357.
Funding Information:
reported personal fees from ArborMetrix, Inc during the conduct of the study. Dr Wiegmann reported personal fees from HFACS, Inc outside the submitted work. Dr Greenberg reported grants from Wisconsin Partnership Program and the National Institutes of Health/National Institute of Diabetes and Digestive and Kidney Diseases (NIH/ NIDDK) during the conduct of the study and serving on the Johnson and Johnson Institute's Global Education Council and as president/founder of the Institute for Surgical Coaching. She is not paid for either of these positions. No other disclosures were reported.
Publisher Copyright:
© 2020 American Medical Association. All rights reserved.
PY - 2020/6
Y1 - 2020/6
N2 - Importance: Surgical coaching continues to gain momentum as an innovative method for continuous professional development. A tool to measure the performance of a surgical coach is needed to provide formative feedback to coaches for continued skill development and to assess the fidelity of a coaching intervention for future research and dissemination. Objective: To evaluate the validity of the Wisconsin Surgical Coaching Rubric (WiSCoR), a novel tool to assess the performance of a peer surgical coach. Design, Setting, and Participants: Surgical coaching sessions from November 2014 through February 2018 conducted by 2 statewide peer surgical coaching programs were audio recorded and transcribed. Twelve raters used WiSCoR to rate the performance of the surgical coach for each session. The study included peer surgical coaches in the Wisconsin Surgical Coaching Program (n = 8) and the Michigan Bariatric Surgery Collaborative coaching program (n = 15). The data were analyzed in 2019. Interventions or Exposures: Use of WiSCoR to rate peer surgical coaching sessions. Main Outcomes and Measures: There were 282 WiSCoR ratings from the 106 coaching sessions included in the study. WiSCoR was evaluated using a framework, including inter-rater reliability assessed with Gwet weighted agreement coefficent. Descriptive statistics of WiSCoR were calculated. Results: Eight coaches (35%) and 11 coachees (29%) were from the Wisconsin Surgical Program and 15 coaches (65%) and 27 coachees (71%) were from the Michigan Bariatric Surgery Collaborative. The validity of WiSCoR is supported by high interrater reliability (Gwet weighted agreement coefficient, 0.87) as well as a weakly positive correlation of WiSCoR to coachee ratings of coaches (r = 0.22; P =.04), rigorous content development, consistent rater training, and the association of WiSCoR with coach and coaching program development. The mean (SD) overall coach performance rating using WiSCoR was 3.23 (0.82; range, 1-5). Conclusions and Relevance: WiSCoR is a reliable measure that can assess the performance of a surgical coach, inform fidelity to coaching principles, and provide formative feedback to surgical coaches. While coachee ratings may reflect coachee satisfaction, they are not able to determine the quality of a coach.
AB - Importance: Surgical coaching continues to gain momentum as an innovative method for continuous professional development. A tool to measure the performance of a surgical coach is needed to provide formative feedback to coaches for continued skill development and to assess the fidelity of a coaching intervention for future research and dissemination. Objective: To evaluate the validity of the Wisconsin Surgical Coaching Rubric (WiSCoR), a novel tool to assess the performance of a peer surgical coach. Design, Setting, and Participants: Surgical coaching sessions from November 2014 through February 2018 conducted by 2 statewide peer surgical coaching programs were audio recorded and transcribed. Twelve raters used WiSCoR to rate the performance of the surgical coach for each session. The study included peer surgical coaches in the Wisconsin Surgical Coaching Program (n = 8) and the Michigan Bariatric Surgery Collaborative coaching program (n = 15). The data were analyzed in 2019. Interventions or Exposures: Use of WiSCoR to rate peer surgical coaching sessions. Main Outcomes and Measures: There were 282 WiSCoR ratings from the 106 coaching sessions included in the study. WiSCoR was evaluated using a framework, including inter-rater reliability assessed with Gwet weighted agreement coefficent. Descriptive statistics of WiSCoR were calculated. Results: Eight coaches (35%) and 11 coachees (29%) were from the Wisconsin Surgical Program and 15 coaches (65%) and 27 coachees (71%) were from the Michigan Bariatric Surgery Collaborative. The validity of WiSCoR is supported by high interrater reliability (Gwet weighted agreement coefficient, 0.87) as well as a weakly positive correlation of WiSCoR to coachee ratings of coaches (r = 0.22; P =.04), rigorous content development, consistent rater training, and the association of WiSCoR with coach and coaching program development. The mean (SD) overall coach performance rating using WiSCoR was 3.23 (0.82; range, 1-5). Conclusions and Relevance: WiSCoR is a reliable measure that can assess the performance of a surgical coach, inform fidelity to coaching principles, and provide formative feedback to surgical coaches. While coachee ratings may reflect coachee satisfaction, they are not able to determine the quality of a coach.
UR - http://www.scopus.com/inward/record.url?scp=85083879905&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85083879905&partnerID=8YFLogxK
U2 - 10.1001/jamasurg.2020.0424
DO - 10.1001/jamasurg.2020.0424
M3 - Article
C2 - 32320026
AN - SCOPUS:85083879905
VL - 155
SP - 486
EP - 492
JO - JAMA Surgery
JF - JAMA Surgery
SN - 2168-6254
IS - 6
ER -