Objective structured clinical examination in basic thoracic ultrasound: a European study of validity evidence
Research output: Contribution to journal › Journal article › Research › peer-review
Documents
- Fulltext
Final published version, 1.41 MB, PDF document
Background: Basic thoracic ultrasound is being used more frequently by clinicians in several settings due to its high diagnostic accuracy for many common causes of respiratory failure and dyspnoea. However, ultrasound examinations are operator-dependent, and sufficient competences are needed to obtain high sensitivity and specificity of examinations. Additionally, it is crucial for ultrasound operators to perceive the competence to interpret the images and integrate them into the patient history and other examinations. This study aims to explore and gather validity evidence for an objective structured clinical examination test of basic thoracic ultrasound competences and establish a pass/fail score. Methods: An expert panel created the test which included two theoretical and five practical stations representing cases with different diagnoses that cause respiratory symptoms and which are possible to establish by basic thoracic ultrasound. Twenty-five participants with different levels of experience in basic thoracic ultrasound completed the test. Data of the test scores were used for item analysis, and exploring validity evidence was done according to Messick’s framework which is recommended. The contrasting groups' standard setting method was used to establish a pass/fail score. Results: The summarised internal consistency reliability was high with a Cronbach’s alpha of 0.87. The novice group (n = 4) had a mean test score of 42 ± 10.1 points, the intermediate group (n = 8) scored 79.1 ± 8.1 points, and the experienced group (n = 13) 89.0 ± 6.2 points (one-way ANOVA, p < 0.001). A pass/fail score of 71 points was thus derived (maximum test score = 105 points). Conclusion: We developed a test for the assessment of clinical competences in basic thoracic ultrasound with solid validity evidence, and a pass/fail standard with no false positives or false negatives.
Original language | English |
---|---|
Article number | 15 |
Journal | BMC Pulmonary Medicine |
Volume | 23 |
Issue number | 1 |
Number of pages | 9 |
ISSN | 1471-2466 |
DOIs | |
Publication status | Published - 2023 |
Bibliographical note
Funding Information:
The authors would like to thank all persons serving as simulated patients and all candidates who participated. A special thanks to all the examiners: Anna Morley, Department of Respiratory Medicine, Southmead Hospital, UK, Jesper Koefod Petersen, Department of Respiratory Medicine, Zealand University Hospital, Roskilde, DK, Katrine Fjællegaard, Department of Respiratory Medicine, Zealand University Hospital, Roskilde, DK, Amanda Dandanell Juel, ODIN – Odense Respiratory Research Unit, Department of Clinical Research, University of Southern Denmark, DK, Siri Aas Smedemark, Geriatric Research Unit, Department of Clinical Research, University of Southern Denmark, DK, Bjørk K. Sofíudóttir, Research Unit of Rheumatology, Department of Clinical Research, University of Southern Denmark, DK, Casper Falster, ODIN – Odense Respiratory Research Unit, Department of Clinical Research, University of Southern Denmark, DK, Inge Raadal Skov, Department of Renal Medicine, Odense University Hospital, DK.
Publisher Copyright:
© 2023, The Author(s).
- Medical education, Thoracic ultrasound, Training, Ultrasound diagnostics
Research areas
ID: 372806681