Cargando…

Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging

BACKGROUND: Obtaining medical data using wearable sensors is a potential replacement for in-hospital monitoring, but the lack of data for such sensors poses a challenge for development. One solution is using in-hospital recordings to boost performance via transfer learning. While there are many poss...

Descripción completa

Detalles Bibliográficos
Autores principales: Waters, Samuel H., Clifford, Gari D.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9465946/
https://www.ncbi.nlm.nih.gov/pubmed/36096868
http://dx.doi.org/10.1186/s12938-022-01033-3
_version_ 1784787897831915520
author Waters, Samuel H.
Clifford, Gari D.
author_facet Waters, Samuel H.
Clifford, Gari D.
author_sort Waters, Samuel H.
collection PubMed
description BACKGROUND: Obtaining medical data using wearable sensors is a potential replacement for in-hospital monitoring, but the lack of data for such sensors poses a challenge for development. One solution is using in-hospital recordings to boost performance via transfer learning. While there are many possible transfer learning algorithms, few have been tested in the domain of EEG-based sleep staging. Furthermore, there are few ways for determining which transfer learning method will work best besides exhaustive testing. Measures of transferability do exist, but are typically used for selection of pre-trained models rather than algorithms and few have been tested on medical signals. We tested several supervised transfer learning algorithms on a sleep staging task using a single channel of EEG (AF7-Fpz) captured from an in-home commercial system. RESULTS: Two neural networks—one bespoke and another state-of-art open-source architecture—were pre-trained on one of six source datasets comprising 11,561 subjects undergoing clinical polysomnograms (PSGs), then re-trained on a target dataset of 75 full-night recordings from 24 subjects. Several transferability measures were then tested to determine which is most effective for assessing performance on unseen target data. Performance on the target dataset was improved using transfer learning, with re-training the head layers being the most effective in the majority of cases (up to 63.9% of cases). Transferability measures generally provided significant correlations with accuracy (up to [Formula: see text] ). CONCLUSION: Re-training the head layers provided the largest performance boost. Transferability measures are useful indicators of transfer learning effectiveness.
format Online
Article
Text
id pubmed-9465946
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-94659462022-09-13 Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging Waters, Samuel H. Clifford, Gari D. Biomed Eng Online Research BACKGROUND: Obtaining medical data using wearable sensors is a potential replacement for in-hospital monitoring, but the lack of data for such sensors poses a challenge for development. One solution is using in-hospital recordings to boost performance via transfer learning. While there are many possible transfer learning algorithms, few have been tested in the domain of EEG-based sleep staging. Furthermore, there are few ways for determining which transfer learning method will work best besides exhaustive testing. Measures of transferability do exist, but are typically used for selection of pre-trained models rather than algorithms and few have been tested on medical signals. We tested several supervised transfer learning algorithms on a sleep staging task using a single channel of EEG (AF7-Fpz) captured from an in-home commercial system. RESULTS: Two neural networks—one bespoke and another state-of-art open-source architecture—were pre-trained on one of six source datasets comprising 11,561 subjects undergoing clinical polysomnograms (PSGs), then re-trained on a target dataset of 75 full-night recordings from 24 subjects. Several transferability measures were then tested to determine which is most effective for assessing performance on unseen target data. Performance on the target dataset was improved using transfer learning, with re-training the head layers being the most effective in the majority of cases (up to 63.9% of cases). Transferability measures generally provided significant correlations with accuracy (up to [Formula: see text] ). CONCLUSION: Re-training the head layers provided the largest performance boost. Transferability measures are useful indicators of transfer learning effectiveness. BioMed Central 2022-09-12 /pmc/articles/PMC9465946/ /pubmed/36096868 http://dx.doi.org/10.1186/s12938-022-01033-3 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Waters, Samuel H.
Clifford, Gari D.
Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging
title Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging
title_full Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging
title_fullStr Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging
title_full_unstemmed Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging
title_short Comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging
title_sort comparison of deep transfer learning algorithms and transferability measures for wearable sleep staging
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9465946/
https://www.ncbi.nlm.nih.gov/pubmed/36096868
http://dx.doi.org/10.1186/s12938-022-01033-3
work_keys_str_mv AT waterssamuelh comparisonofdeeptransferlearningalgorithmsandtransferabilitymeasuresforwearablesleepstaging
AT cliffordgarid comparisonofdeeptransferlearningalgorithmsandtransferabilitymeasuresforwearablesleepstaging