TY - JOUR
T1 - Entrustable Professional Activities in General Surgery
T2 - Trends in Resident Self-Assessment
AU - Stahl, Christopher C.
AU - Jung, Sarah A.
AU - Rosser, Alexandra A.
AU - Kraut, Aaron S.
AU - Schnapp, Benjamin H.
AU - Westergaard, Mary
AU - Hamedani, Azita G.
AU - Minter, Rebecca M.
AU - Greenberg, Jacob A.
N1 - Publisher Copyright:
© 2020
PY - 2020/11/1
Y1 - 2020/11/1
N2 - Objective: Effective self-assessment is a cornerstone of lifelong professional development; however, evidence suggests physicians have a limited ability to self-assess. Novel strategies to improve the accuracy of learner self-assessment are needed. Our institution's surgical entrustable professional activity (EPA) implementation strategy incorporates resident self-assessment to address this issue. This study evaluates the accuracy of resident self-assessment versus faculty assessment across 5 EPAs in general surgery. Design, Setting, Participants: Within a single academic general surgery residency program, assessment data for 5 surgery EPAs was prospectively collected using a mobile application. Matched assessments (resident and faculty assessments for the same clinical encounter) were identified and the remainder excluded. Assessment scores were compared using Welch's t test. Agreement was analyzed using Cohen's kappa with squared weights. Results: One thousand eight hundred and fifty-seven EPA assessments were collected in 17 months following implementation. One thousand one hundred and fifty-five (62.2%) were matched pairs. Residents under-rated their own performance relative to faculty assessments (2.36 vs 2.65, p < 0.01). This pattern held true for all subsets except for Postgraduate Year (PGY)2 residents and Inguinal Hernia EPAs. There was at least moderate agreement between matched resident and faculty EPA assessment scores (κ = 0.57). This was consistent for all EPAs except Trauma evaluations, which were completed by faculty from 2 different departments. Surgery resident self-assessments more strongly agreed with Surgery faculty assessments than Emergency Medicine faculty assessments (κ = 0.58 vs 0.36). Conclusions: Resident EPA self-assessments are equivalent or slightly lower than faculty assessments across a wide breadth of clinical scenarios. Resident and faculty matched assessments demonstrate moderate agreement.
AB - Objective: Effective self-assessment is a cornerstone of lifelong professional development; however, evidence suggests physicians have a limited ability to self-assess. Novel strategies to improve the accuracy of learner self-assessment are needed. Our institution's surgical entrustable professional activity (EPA) implementation strategy incorporates resident self-assessment to address this issue. This study evaluates the accuracy of resident self-assessment versus faculty assessment across 5 EPAs in general surgery. Design, Setting, Participants: Within a single academic general surgery residency program, assessment data for 5 surgery EPAs was prospectively collected using a mobile application. Matched assessments (resident and faculty assessments for the same clinical encounter) were identified and the remainder excluded. Assessment scores were compared using Welch's t test. Agreement was analyzed using Cohen's kappa with squared weights. Results: One thousand eight hundred and fifty-seven EPA assessments were collected in 17 months following implementation. One thousand one hundred and fifty-five (62.2%) were matched pairs. Residents under-rated their own performance relative to faculty assessments (2.36 vs 2.65, p < 0.01). This pattern held true for all subsets except for Postgraduate Year (PGY)2 residents and Inguinal Hernia EPAs. There was at least moderate agreement between matched resident and faculty EPA assessment scores (κ = 0.57). This was consistent for all EPAs except Trauma evaluations, which were completed by faculty from 2 different departments. Surgery resident self-assessments more strongly agreed with Surgery faculty assessments than Emergency Medicine faculty assessments (κ = 0.58 vs 0.36). Conclusions: Resident EPA self-assessments are equivalent or slightly lower than faculty assessments across a wide breadth of clinical scenarios. Resident and faculty matched assessments demonstrate moderate agreement.
KW - Practice-Based Learning and Improvement
KW - education
KW - entrustable professional activities
KW - self-assessment
KW - surgery residency
UR - http://www.scopus.com/inward/record.url?scp=85086563027&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85086563027&partnerID=8YFLogxK
U2 - 10.1016/j.jsurg.2020.05.005
DO - 10.1016/j.jsurg.2020.05.005
M3 - Article
C2 - 32540120
AN - SCOPUS:85086563027
SN - 1931-7204
VL - 77
SP - 1562
EP - 1567
JO - Journal of surgical education
JF - Journal of surgical education
IS - 6
ER -