Cargando…
Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation
PURPOSE: Laryngeal electromyography (LEMG) has been considered as gold standard in diagnostics of vocal fold movement impairment, but is still not commonly implemented in clinical routine. Since the signal interpretation of LEMG signals (LEMGs) is often a subjective and semi-quantitative matter, the...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6757022/ https://www.ncbi.nlm.nih.gov/pubmed/31312924 http://dx.doi.org/10.1007/s00405-019-05553-y |
_version_ | 1783453498241712128 |
---|---|
author | Ho, Guan-Yuh Leonhard, Matthias Volk, Gerd Fabian Foerster, Gerhard Pototschnig, Claus Klinge, Kathleen Granitzka, Thordis Zienau, Anne-Kristin Schneider-Stickler, Berit |
author_facet | Ho, Guan-Yuh Leonhard, Matthias Volk, Gerd Fabian Foerster, Gerhard Pototschnig, Claus Klinge, Kathleen Granitzka, Thordis Zienau, Anne-Kristin Schneider-Stickler, Berit |
author_sort | Ho, Guan-Yuh |
collection | PubMed |
description | PURPOSE: Laryngeal electromyography (LEMG) has been considered as gold standard in diagnostics of vocal fold movement impairment, but is still not commonly implemented in clinical routine. Since the signal interpretation of LEMG signals (LEMGs) is often a subjective and semi-quantitative matter, the goal of this study was to evaluate the inter-rater reliability of neurolaryngologists on LEMGs of volitional muscle activity. METHODS: For this study, 52 representative LEMGs of 371 LEMG datasets were selected from a multicenter registry for a blinded evaluation by 7 experienced members of the neurolaryngology working group of the European Laryngological Society (ELS). For the measurement of the observer agreement between two raters, Cohen’s Kappa statistic was calculated. For the interpretation of agreements of diagnoses among the seven examiners, we used the Fleiss’ Kappa statistic. RESULT: When focusing on the categories “no activity”, “single fiber pattern”, and “strongly decreased recruitment pattern”, the inter-rater agreement varied from Cohen’s Kappa values between 0.48 and 0.84, indicating moderate to near-perfect agreement between the rater pairs. Calculating with Fleiss’ Kappa, a value of 0.61 showed good agreement among the seven raters. For the rating categories, the Fleiss’ Kappa value ranged from 0.52 to 0.74, which also showed a good agreement. CONCLUSION: A good inter-rater agreement between the participating neurolaryngologists was achieved in the interpretation of LEMGs. More instructional courses should be offered to broadly implement LEMG as a reliable diagnostic tool in evaluating vocal fold movement disorders in clinical routine and to develop future algorithms for therapy and computer-assisted examination. |
format | Online Article Text |
id | pubmed-6757022 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-67570222019-10-07 Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation Ho, Guan-Yuh Leonhard, Matthias Volk, Gerd Fabian Foerster, Gerhard Pototschnig, Claus Klinge, Kathleen Granitzka, Thordis Zienau, Anne-Kristin Schneider-Stickler, Berit Eur Arch Otorhinolaryngol Laryngology PURPOSE: Laryngeal electromyography (LEMG) has been considered as gold standard in diagnostics of vocal fold movement impairment, but is still not commonly implemented in clinical routine. Since the signal interpretation of LEMG signals (LEMGs) is often a subjective and semi-quantitative matter, the goal of this study was to evaluate the inter-rater reliability of neurolaryngologists on LEMGs of volitional muscle activity. METHODS: For this study, 52 representative LEMGs of 371 LEMG datasets were selected from a multicenter registry for a blinded evaluation by 7 experienced members of the neurolaryngology working group of the European Laryngological Society (ELS). For the measurement of the observer agreement between two raters, Cohen’s Kappa statistic was calculated. For the interpretation of agreements of diagnoses among the seven examiners, we used the Fleiss’ Kappa statistic. RESULT: When focusing on the categories “no activity”, “single fiber pattern”, and “strongly decreased recruitment pattern”, the inter-rater agreement varied from Cohen’s Kappa values between 0.48 and 0.84, indicating moderate to near-perfect agreement between the rater pairs. Calculating with Fleiss’ Kappa, a value of 0.61 showed good agreement among the seven raters. For the rating categories, the Fleiss’ Kappa value ranged from 0.52 to 0.74, which also showed a good agreement. CONCLUSION: A good inter-rater agreement between the participating neurolaryngologists was achieved in the interpretation of LEMGs. More instructional courses should be offered to broadly implement LEMG as a reliable diagnostic tool in evaluating vocal fold movement disorders in clinical routine and to develop future algorithms for therapy and computer-assisted examination. Springer Berlin Heidelberg 2019-07-16 2019 /pmc/articles/PMC6757022/ /pubmed/31312924 http://dx.doi.org/10.1007/s00405-019-05553-y Text en © The Author(s) 2019 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
spellingShingle | Laryngology Ho, Guan-Yuh Leonhard, Matthias Volk, Gerd Fabian Foerster, Gerhard Pototschnig, Claus Klinge, Kathleen Granitzka, Thordis Zienau, Anne-Kristin Schneider-Stickler, Berit Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation |
title | Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation |
title_full | Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation |
title_fullStr | Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation |
title_full_unstemmed | Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation |
title_short | Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation |
title_sort | inter-rater reliability of seven neurolaryngologists in laryngeal emg signal interpretation |
topic | Laryngology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6757022/ https://www.ncbi.nlm.nih.gov/pubmed/31312924 http://dx.doi.org/10.1007/s00405-019-05553-y |
work_keys_str_mv | AT hoguanyuh interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT leonhardmatthias interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT volkgerdfabian interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT foerstergerhard interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT pototschnigclaus interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT klingekathleen interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT granitzkathordis interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT zienauannekristin interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation AT schneidersticklerberit interraterreliabilityofsevenneurolaryngologistsinlaryngealemgsignalinterpretation |