TY - JOUR

T1 - Generating a Prioritized List of Operative Procedures for Simulation-based Assessment of General Surgery Trainees Through Consensus

AU - Toale, Conor

AU - Morris, Marie

AU - Konge, Lars

AU - Nayahangan, Leizl Joy

AU - Roche, Adam

AU - Heskin, Leonie

AU - Kavanagh, Dara O.

N1 - Publisher Copyright: © 2024 Wolters Kluwer Health. All rights reserved.

PY - 2024

Y1 - 2024

N2 - Objective: To develop appropriate content for high-stakes simulation-based assessments of operative competence in general surgery training through consensus. Background: Valid methods of summative operative competence assessment are required by competency-based training programs in surgery. Method: An online Delphi consensus study was conducted. Procedures were derived from the competency expectations outlined by the Joint Committee on Surgical Training Curriculum 2021, and subsequent brainstorming. Procedures were rated according to their perceived importance, perceived procedural risk, how frequently they are performed, and simualtion feasibility by a purposive sample of 30 surgical trainers and a 5-person steering group. A modified Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula was applied to the generated data to produce ranked procedural lists, which were returned to participants for re-prioritization. Results: Prioritized lists were generated for simulation-based operative competence assessments at 2 key stages of training; the end of 'phase 2' prior to the development of a sub-specialty interest, and the end of 'phase 3', that is, end-of-training certification. A total of 21 and 16 procedures were deemed suitable for assessments at each of these stages, respectively. Conclusions: This study describes a national needs assessment approach to content generation for simulation-based assessments of operative competence in general surgery using Delphi consensus methodology. The prioritized procedural lists generated by this study can be used to further develop operative skill assessments for use in high-stakes scenarios, such as trainee progression, entrustment, and end-of-training certification, before subsequent validity testing.

AB - Objective: To develop appropriate content for high-stakes simulation-based assessments of operative competence in general surgery training through consensus. Background: Valid methods of summative operative competence assessment are required by competency-based training programs in surgery. Method: An online Delphi consensus study was conducted. Procedures were derived from the competency expectations outlined by the Joint Committee on Surgical Training Curriculum 2021, and subsequent brainstorming. Procedures were rated according to their perceived importance, perceived procedural risk, how frequently they are performed, and simualtion feasibility by a purposive sample of 30 surgical trainers and a 5-person steering group. A modified Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula was applied to the generated data to produce ranked procedural lists, which were returned to participants for re-prioritization. Results: Prioritized lists were generated for simulation-based operative competence assessments at 2 key stages of training; the end of 'phase 2' prior to the development of a sub-specialty interest, and the end of 'phase 3', that is, end-of-training certification. A total of 21 and 16 procedures were deemed suitable for assessments at each of these stages, respectively. Conclusions: This study describes a national needs assessment approach to content generation for simulation-based assessments of operative competence in general surgery using Delphi consensus methodology. The prioritized procedural lists generated by this study can be used to further develop operative skill assessments for use in high-stakes scenarios, such as trainee progression, entrustment, and end-of-training certification, before subsequent validity testing.

KW - assessment

KW - competency-based education

KW - delphi study

KW - performance of procedures

KW - simulation

KW - surgery

KW - surgical skill

U2 - 10.1097/SLA.0000000000006118

DO - 10.1097/SLA.0000000000006118

M3 - Journal article

C2 - 37811854

AN - SCOPUS:85190106430

VL - 279

SP - 900

EP - 905

JO - Advances in Surgery

JF - Advances in Surgery

SN - 0003-4932

IS - 5

ER -