Cargando…

Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability

Scoring sleep stages from biological signals is an essential but labor-intensive inspection for sleep diagnosis. The existing automated scoring methods have achieved high accuracy but are not widely applied in clinical practice. In our understanding, the existing methods have failed to establish the...

Descripción completa

Detalles Bibliográficos
Autores principales: Horie, Kazumasa, Ota, Leo, Miyamoto, Ryusuke, Abe, Takashi, Suzuki, Yoko, Kawana, Fusae, Kokubo, Toshio, Yanagisawa, Masashi, Kitagawa, Hiroyuki
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9329306/
https://www.ncbi.nlm.nih.gov/pubmed/35896616
http://dx.doi.org/10.1038/s41598-022-16334-9
_version_ 1784757891264151552
author Horie, Kazumasa
Ota, Leo
Miyamoto, Ryusuke
Abe, Takashi
Suzuki, Yoko
Kawana, Fusae
Kokubo, Toshio
Yanagisawa, Masashi
Kitagawa, Hiroyuki
author_facet Horie, Kazumasa
Ota, Leo
Miyamoto, Ryusuke
Abe, Takashi
Suzuki, Yoko
Kawana, Fusae
Kokubo, Toshio
Yanagisawa, Masashi
Kitagawa, Hiroyuki
author_sort Horie, Kazumasa
collection PubMed
description Scoring sleep stages from biological signals is an essential but labor-intensive inspection for sleep diagnosis. The existing automated scoring methods have achieved high accuracy but are not widely applied in clinical practice. In our understanding, the existing methods have failed to establish the trust of sleep experts (e.g., physicians and clinical technologists) due to a lack of ability to explain the evidences/clues for scoring. In this study, we developed a deep-learning-based scoring model with a reasoning mechanism called class activation mapping (CAM) to solve this problem. This mechanism explicitly shows which portions of the signals support our model’s sleep stage decision, and we verified that these portions overlap with the “characteristic waves,” which are evidences/clues used in the manual scoring process. In exchange for the acquisition of explainability, employing CAM makes it difficult to follow some scoring rules. Although we concerned the negative effect of CAM on the scoring accuracy, we have found that the impact is limited. The evaluation experiment shows that the proposed model achieved a scoring accuracy of [Formula: see text] . It is superior to those of some existing methods and the inter-rater reliability among the sleep experts. These results suggest that Sleep-CAM achieved both explainability and required scoring accuracy for practical usage.
format Online
Article
Text
id pubmed-9329306
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-93293062022-07-29 Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability Horie, Kazumasa Ota, Leo Miyamoto, Ryusuke Abe, Takashi Suzuki, Yoko Kawana, Fusae Kokubo, Toshio Yanagisawa, Masashi Kitagawa, Hiroyuki Sci Rep Article Scoring sleep stages from biological signals is an essential but labor-intensive inspection for sleep diagnosis. The existing automated scoring methods have achieved high accuracy but are not widely applied in clinical practice. In our understanding, the existing methods have failed to establish the trust of sleep experts (e.g., physicians and clinical technologists) due to a lack of ability to explain the evidences/clues for scoring. In this study, we developed a deep-learning-based scoring model with a reasoning mechanism called class activation mapping (CAM) to solve this problem. This mechanism explicitly shows which portions of the signals support our model’s sleep stage decision, and we verified that these portions overlap with the “characteristic waves,” which are evidences/clues used in the manual scoring process. In exchange for the acquisition of explainability, employing CAM makes it difficult to follow some scoring rules. Although we concerned the negative effect of CAM on the scoring accuracy, we have found that the impact is limited. The evaluation experiment shows that the proposed model achieved a scoring accuracy of [Formula: see text] . It is superior to those of some existing methods and the inter-rater reliability among the sleep experts. These results suggest that Sleep-CAM achieved both explainability and required scoring accuracy for practical usage. Nature Publishing Group UK 2022-07-27 /pmc/articles/PMC9329306/ /pubmed/35896616 http://dx.doi.org/10.1038/s41598-022-16334-9 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Horie, Kazumasa
Ota, Leo
Miyamoto, Ryusuke
Abe, Takashi
Suzuki, Yoko
Kawana, Fusae
Kokubo, Toshio
Yanagisawa, Masashi
Kitagawa, Hiroyuki
Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability
title Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability
title_full Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability
title_fullStr Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability
title_full_unstemmed Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability
title_short Automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability
title_sort automated sleep stage scoring employing a reasoning mechanism and evaluation of its explainability
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9329306/
https://www.ncbi.nlm.nih.gov/pubmed/35896616
http://dx.doi.org/10.1038/s41598-022-16334-9
work_keys_str_mv AT horiekazumasa automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT otaleo automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT miyamotoryusuke automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT abetakashi automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT suzukiyoko automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT kawanafusae automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT kokubotoshio automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT yanagisawamasashi automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability
AT kitagawahiroyuki automatedsleepstagescoringemployingareasoningmechanismandevaluationofitsexplainability