Cargando…

Development and validation of a simulation-based assessment tool in colonoscopy

BACKGROUND: Colonoscopy is difficult to learn. Virtual reality simulation training is helpful, but how and when novices should progress to patient-based training has yet to be established. To date, there is no assessment tool for credentialing novice endoscopists prior to clinical practice. The aim...

Descripción completa

Detalles Bibliográficos
Autores principales: Jaensch, Claudia, Jensen, Rune D., Paltved, Charlotte, Madsen, Anders H.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10413715/
https://www.ncbi.nlm.nih.gov/pubmed/37563741
http://dx.doi.org/10.1186/s41077-023-00260-5
_version_ 1785087194305658880
author Jaensch, Claudia
Jensen, Rune D.
Paltved, Charlotte
Madsen, Anders H.
author_facet Jaensch, Claudia
Jensen, Rune D.
Paltved, Charlotte
Madsen, Anders H.
author_sort Jaensch, Claudia
collection PubMed
description BACKGROUND: Colonoscopy is difficult to learn. Virtual reality simulation training is helpful, but how and when novices should progress to patient-based training has yet to be established. To date, there is no assessment tool for credentialing novice endoscopists prior to clinical practice. The aim of this study was to develop such an assessment tool based on metrics provided by the simulator. The metrics used for the assessment tool should be able to discriminate between novices, intermediates, and experts and include essential checklist items for patient safety. METHODS: The validation process was conducted based on the Standards for Educational and Psychological Testing. An expert panel decided upon three essential checklist items for patient safety based on Lawshe’s method: perforation, hazardous tension to the bowel wall, and cecal intubation. A power calculation was performed. In this study, the Simbionix GI Mentor II simulator was used. Metrics with discriminatory ability were identified with variance analysis and combined to form an aggregate score. Based on this score and the essential items, pass/fail standards were set and reliability was tested. RESULTS: Twenty-four participants (eight novices, eight intermediates, and eight expert endoscopists) performed two simulated colonoscopies. Four metrics with discriminatory ability were identified. The aggregate score ranged from 4.2 to 51.2 points. Novices had a mean score of 10.00 (SD 5.13), intermediates 24.63 (SD 7.91), and experts 30.72 (SD 11.98). The difference in score between novices and the other two groups was statistically significant (p<0.01). Although expert endoscopists had a higher score, the difference was not statistically significant (p=0.40). Reliability was good (Cronbach’s alpha=0.86). A pass/fail score was defined at 17.1 points with correct completion of three essential checklist items, resulting in three experts and three intermediates failing and one novice passing the assessment. CONCLUSION: We established a valid and reliable assessment tool with a pass/fail standard on the simulator. We suggest using the assessment after simulation-based training before commencing work-based learning.
format Online
Article
Text
id pubmed-10413715
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-104137152023-08-11 Development and validation of a simulation-based assessment tool in colonoscopy Jaensch, Claudia Jensen, Rune D. Paltved, Charlotte Madsen, Anders H. Adv Simul (Lond) Research BACKGROUND: Colonoscopy is difficult to learn. Virtual reality simulation training is helpful, but how and when novices should progress to patient-based training has yet to be established. To date, there is no assessment tool for credentialing novice endoscopists prior to clinical practice. The aim of this study was to develop such an assessment tool based on metrics provided by the simulator. The metrics used for the assessment tool should be able to discriminate between novices, intermediates, and experts and include essential checklist items for patient safety. METHODS: The validation process was conducted based on the Standards for Educational and Psychological Testing. An expert panel decided upon three essential checklist items for patient safety based on Lawshe’s method: perforation, hazardous tension to the bowel wall, and cecal intubation. A power calculation was performed. In this study, the Simbionix GI Mentor II simulator was used. Metrics with discriminatory ability were identified with variance analysis and combined to form an aggregate score. Based on this score and the essential items, pass/fail standards were set and reliability was tested. RESULTS: Twenty-four participants (eight novices, eight intermediates, and eight expert endoscopists) performed two simulated colonoscopies. Four metrics with discriminatory ability were identified. The aggregate score ranged from 4.2 to 51.2 points. Novices had a mean score of 10.00 (SD 5.13), intermediates 24.63 (SD 7.91), and experts 30.72 (SD 11.98). The difference in score between novices and the other two groups was statistically significant (p<0.01). Although expert endoscopists had a higher score, the difference was not statistically significant (p=0.40). Reliability was good (Cronbach’s alpha=0.86). A pass/fail score was defined at 17.1 points with correct completion of three essential checklist items, resulting in three experts and three intermediates failing and one novice passing the assessment. CONCLUSION: We established a valid and reliable assessment tool with a pass/fail standard on the simulator. We suggest using the assessment after simulation-based training before commencing work-based learning. BioMed Central 2023-08-10 /pmc/articles/PMC10413715/ /pubmed/37563741 http://dx.doi.org/10.1186/s41077-023-00260-5 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Jaensch, Claudia
Jensen, Rune D.
Paltved, Charlotte
Madsen, Anders H.
Development and validation of a simulation-based assessment tool in colonoscopy
title Development and validation of a simulation-based assessment tool in colonoscopy
title_full Development and validation of a simulation-based assessment tool in colonoscopy
title_fullStr Development and validation of a simulation-based assessment tool in colonoscopy
title_full_unstemmed Development and validation of a simulation-based assessment tool in colonoscopy
title_short Development and validation of a simulation-based assessment tool in colonoscopy
title_sort development and validation of a simulation-based assessment tool in colonoscopy
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10413715/
https://www.ncbi.nlm.nih.gov/pubmed/37563741
http://dx.doi.org/10.1186/s41077-023-00260-5
work_keys_str_mv AT jaenschclaudia developmentandvalidationofasimulationbasedassessmenttoolincolonoscopy
AT jensenruned developmentandvalidationofasimulationbasedassessmenttoolincolonoscopy
AT paltvedcharlotte developmentandvalidationofasimulationbasedassessmenttoolincolonoscopy
AT madsenandersh developmentandvalidationofasimulationbasedassessmenttoolincolonoscopy