Cargando…
Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training
The increase in minimally invasive surgery has led to a decrease in surgical experience. To date, there is only limited research examining whether skills are evaluated objectively and equally in simulation training, especially in microsurgery. The purpose of this study was to analyze the objectivity...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The Japan Neurosurgical Society
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8666297/ https://www.ncbi.nlm.nih.gov/pubmed/34629352 http://dx.doi.org/10.2176/nmc.oa.2021-0191 |
_version_ | 1784614177853145088 |
---|---|
author | MURAI, Yasuo SATO, Shun TSUKIYAMA, Atsushi KUBOTA, Asami MORITA, Akio |
author_facet | MURAI, Yasuo SATO, Shun TSUKIYAMA, Atsushi KUBOTA, Asami MORITA, Akio |
author_sort | MURAI, Yasuo |
collection | PubMed |
description | The increase in minimally invasive surgery has led to a decrease in surgical experience. To date, there is only limited research examining whether skills are evaluated objectively and equally in simulation training, especially in microsurgery. The purpose of this study was to analyze the objectivity and equality of simulation evaluation results conducted in a contest format. A nationwide recruitment process was conducted to select study participants. Participants were recruited from a pool of qualified physicians with less than 10 years of experience. In this study, the simulation procedure consisted of incising a 1 mm thick blood vessel and suturing it with a 10-0 thread using a microscope. Initially, we planned to have the neurosurgical supervisors score the simulation procedure by direct observation. However, due to COVID-19, some study participants were unable to attend. Thus requiring some simulation procedures to be scored by video review. A total of 14 trainees participated in the study. The Cronbach’s alpha coefficient among the scorers was 0.99, indicating a strong correlation. There was no statistically significant difference between the scores from the video review and direct observation judgments. There was a statistically significant difference (p <0.001) between the scores for some criteria. For the eight criteria, individual scorers assigned scores in a consistent pattern. However, this pattern differed between scorers indicating that some scorers were more lenient than others. The results indicate that both video review and direct observation methods are highly objective techniques evaluate simulation procedures. |
format | Online Article Text |
id | pubmed-8666297 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | The Japan Neurosurgical Society |
record_format | MEDLINE/PubMed |
spelling | pubmed-86662972021-12-16 Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training MURAI, Yasuo SATO, Shun TSUKIYAMA, Atsushi KUBOTA, Asami MORITA, Akio Neurol Med Chir (Tokyo) Original Article The increase in minimally invasive surgery has led to a decrease in surgical experience. To date, there is only limited research examining whether skills are evaluated objectively and equally in simulation training, especially in microsurgery. The purpose of this study was to analyze the objectivity and equality of simulation evaluation results conducted in a contest format. A nationwide recruitment process was conducted to select study participants. Participants were recruited from a pool of qualified physicians with less than 10 years of experience. In this study, the simulation procedure consisted of incising a 1 mm thick blood vessel and suturing it with a 10-0 thread using a microscope. Initially, we planned to have the neurosurgical supervisors score the simulation procedure by direct observation. However, due to COVID-19, some study participants were unable to attend. Thus requiring some simulation procedures to be scored by video review. A total of 14 trainees participated in the study. The Cronbach’s alpha coefficient among the scorers was 0.99, indicating a strong correlation. There was no statistically significant difference between the scores from the video review and direct observation judgments. There was a statistically significant difference (p <0.001) between the scores for some criteria. For the eight criteria, individual scorers assigned scores in a consistent pattern. However, this pattern differed between scorers indicating that some scorers were more lenient than others. The results indicate that both video review and direct observation methods are highly objective techniques evaluate simulation procedures. The Japan Neurosurgical Society 2021-12 2021-10-08 /pmc/articles/PMC8666297/ /pubmed/34629352 http://dx.doi.org/10.2176/nmc.oa.2021-0191 Text en © 2021 The Japan Neurosurgical Society https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ (https://creativecommons.org/licenses/by-nc-nd/4.0/) |
spellingShingle | Original Article MURAI, Yasuo SATO, Shun TSUKIYAMA, Atsushi KUBOTA, Asami MORITA, Akio Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training |
title | Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training |
title_full | Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training |
title_fullStr | Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training |
title_full_unstemmed | Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training |
title_short | Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training |
title_sort | investigation of objectivity in scoring and evaluating microvascular anastomosis simulation training |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8666297/ https://www.ncbi.nlm.nih.gov/pubmed/34629352 http://dx.doi.org/10.2176/nmc.oa.2021-0191 |
work_keys_str_mv | AT muraiyasuo investigationofobjectivityinscoringandevaluatingmicrovascularanastomosissimulationtraining AT satoshun investigationofobjectivityinscoringandevaluatingmicrovascularanastomosissimulationtraining AT tsukiyamaatsushi investigationofobjectivityinscoringandevaluatingmicrovascularanastomosissimulationtraining AT kubotaasami investigationofobjectivityinscoringandevaluatingmicrovascularanastomosissimulationtraining AT moritaakio investigationofobjectivityinscoringandevaluatingmicrovascularanastomosissimulationtraining |