Assessing competence in cochlear implant surgery using the newly developed Cochlear Implant Surgery Assessment Tool
Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Purpose: To develop and gather validity evidence for a novel tool for assessment of cochlear implant (CI) surgery, including virtual reality CI surgery training. Methods: Prospective study gathering validity evidence according to Messick’s framework. Four experts developed the CI Surgery Assessment Tool (CISAT). A total of 35 true novices (medical students), trained novices (residents) and CI surgeons performed two CI-procedures each in the Visible Ear Simulator, which were rated by three blinded experts. Classical test theory and generalizability theory were used for reliability analysis. Results: The CISAT significantly discriminated between the three groups (p < 0.001). The generalizability coefficient was 0.76 and most of the score variance (53.3%) was attributable to the participant and only 6.8% to the raters. When exploring a standard setting for CI surgery, the contrasting groups method suggested a pass/fail score of 36.0 points (out of 55), but since the trained novices performed above this, we propose using the mean CI surgeon performance score (45.3 points). Conclusion: Validity evidence for simulation-based assessment of CI performance supports the CISAT. Together with the standard setting, the CISAT might be used to monitor progress in competency-based training of CI surgery and to determine when the trainee can advance to further training.
| Originalsprog | Engelsk |
|---|---|
| Tidsskrift | European Archives of Oto-Rhino-Laryngology |
| Vol/bind | 279 |
| Udgave nummer | 1 |
| Sider (fra-til) | 127-136 |
| Antal sider | 10 |
| ISSN | 0937-4477 |
| DOI | |
| Status | Udgivet - 2022 |
Bibliografisk note
Funding Information:
The authors want to thank the cochlear implant surgeons who generously contributed to the performance data: our colleagues from Nationwide Children’s Hospital and the Ohio State University, Columbus, OH, USA; Sankt Gertrauden-Krankenhaus, Berlin, Germany; Queen Elizabeth Hospital, Birmingham, England, UK; Odense University Hospital, Odense, Denmark; Aarhus University Hospital, Aarhus, Denmark; and Rigshospitalet University Hospital, Copenhagen, Denmark. The Oticon Foundation and MED-EL supported the general development of the Visible Ear Simulator software. The Oticon Foundation supported the first author with an unrestricted grant for PhD-studies.
Funding Information:
The authors want to thank the cochlear implant surgeons who generously contributed to the performance data: our colleagues from Nationwide Children’s Hospital and the Ohio State University, Columbus, OH, USA; Sankt Gertrauden-Krankenhaus, Berlin, Germany; Queen Elizabeth Hospital, Birmingham, England, UK; Odense University Hospital, Odense, Denmark; Aarhus University Hospital, Aarhus, Denmark; and Rigshospitalet University Hospital, Copenhagen, Denmark. The Oticon Foundation and MED-EL supported the general development of the Visible Ear Simulator software. The Oticon Foundation supported the first author with an unrestricted grant for PhD-studies.
Publisher Copyright:
© 2021, The Author(s), under exclusive licence to Springer-Verlag GmbH, DE part of Springer Nature.
ID: 313768147