Cargando…

A machine-learning based objective measure for ALS disease severity

Amyotrophic Lateral Sclerosis (ALS) disease severity is usually measured using the subjective, questionnaire-based revised ALS Functional Rating Scale (ALSFRS-R). Objective measures of disease severity would be powerful tools for evaluating real-world drug effectiveness, efficacy in clinical trials,...

Descripción completa

Detalles Bibliográficos
Autores principales: Vieira, Fernando G., Venugopalan, Subhashini, Premasiri, Alan S., McNally, Maeve, Jansen, Aren, McCloskey, Kevin, Brenner, Michael P., Perrin, Steven
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8993812/
https://www.ncbi.nlm.nih.gov/pubmed/35396385
http://dx.doi.org/10.1038/s41746-022-00588-8
_version_ 1784683980901056512
author Vieira, Fernando G.
Venugopalan, Subhashini
Premasiri, Alan S.
McNally, Maeve
Jansen, Aren
McCloskey, Kevin
Brenner, Michael P.
Perrin, Steven
author_facet Vieira, Fernando G.
Venugopalan, Subhashini
Premasiri, Alan S.
McNally, Maeve
Jansen, Aren
McCloskey, Kevin
Brenner, Michael P.
Perrin, Steven
author_sort Vieira, Fernando G.
collection PubMed
description Amyotrophic Lateral Sclerosis (ALS) disease severity is usually measured using the subjective, questionnaire-based revised ALS Functional Rating Scale (ALSFRS-R). Objective measures of disease severity would be powerful tools for evaluating real-world drug effectiveness, efficacy in clinical trials, and for identifying participants for cohort studies. We developed a machine learning (ML) based objective measure for ALS disease severity based on voice samples and accelerometer measurements from a four-year longitudinal dataset. 584 people living with ALS consented and carried out prescribed speaking and limb-based tasks. 542 participants contributed 5814 voice recordings, and 350 contributed 13,009 accelerometer samples, while simultaneously measuring ALSFRS-R scores. Using these data, we trained ML models to predict bulbar-related and limb-related ALSFRS-R scores. On the test set (n = 109 participants) the voice models achieved a multiclass AUC of 0.86 (95% CI, 0.85–0.88) on speech ALSFRS-R prediction, whereas the accelerometer models achieved a median multiclass AUC of 0.73 on 6 limb-related functions. The correlations across functions observed in self-reported ALSFRS-R scores were preserved in ML-derived scores. We used these models and self-reported ALSFRS-R scores to evaluate the real-world effects of edaravone, a drug approved for use in ALS. In the cohort of 54 test participants who received edaravone as part of their usual care, the ML-derived scores were consistent with the self-reported ALSFRS-R scores. At the individual level, the continuous ML-derived score can capture gradual changes that are absent in the integer ALSFRS-R scores. This demonstrates the value of these tools for assessing disease severity and, potentially, drug effects.
format Online
Article
Text
id pubmed-8993812
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-89938122022-04-22 A machine-learning based objective measure for ALS disease severity Vieira, Fernando G. Venugopalan, Subhashini Premasiri, Alan S. McNally, Maeve Jansen, Aren McCloskey, Kevin Brenner, Michael P. Perrin, Steven NPJ Digit Med Article Amyotrophic Lateral Sclerosis (ALS) disease severity is usually measured using the subjective, questionnaire-based revised ALS Functional Rating Scale (ALSFRS-R). Objective measures of disease severity would be powerful tools for evaluating real-world drug effectiveness, efficacy in clinical trials, and for identifying participants for cohort studies. We developed a machine learning (ML) based objective measure for ALS disease severity based on voice samples and accelerometer measurements from a four-year longitudinal dataset. 584 people living with ALS consented and carried out prescribed speaking and limb-based tasks. 542 participants contributed 5814 voice recordings, and 350 contributed 13,009 accelerometer samples, while simultaneously measuring ALSFRS-R scores. Using these data, we trained ML models to predict bulbar-related and limb-related ALSFRS-R scores. On the test set (n = 109 participants) the voice models achieved a multiclass AUC of 0.86 (95% CI, 0.85–0.88) on speech ALSFRS-R prediction, whereas the accelerometer models achieved a median multiclass AUC of 0.73 on 6 limb-related functions. The correlations across functions observed in self-reported ALSFRS-R scores were preserved in ML-derived scores. We used these models and self-reported ALSFRS-R scores to evaluate the real-world effects of edaravone, a drug approved for use in ALS. In the cohort of 54 test participants who received edaravone as part of their usual care, the ML-derived scores were consistent with the self-reported ALSFRS-R scores. At the individual level, the continuous ML-derived score can capture gradual changes that are absent in the integer ALSFRS-R scores. This demonstrates the value of these tools for assessing disease severity and, potentially, drug effects. Nature Publishing Group UK 2022-04-08 /pmc/articles/PMC8993812/ /pubmed/35396385 http://dx.doi.org/10.1038/s41746-022-00588-8 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Vieira, Fernando G.
Venugopalan, Subhashini
Premasiri, Alan S.
McNally, Maeve
Jansen, Aren
McCloskey, Kevin
Brenner, Michael P.
Perrin, Steven
A machine-learning based objective measure for ALS disease severity
title A machine-learning based objective measure for ALS disease severity
title_full A machine-learning based objective measure for ALS disease severity
title_fullStr A machine-learning based objective measure for ALS disease severity
title_full_unstemmed A machine-learning based objective measure for ALS disease severity
title_short A machine-learning based objective measure for ALS disease severity
title_sort machine-learning based objective measure for als disease severity
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8993812/
https://www.ncbi.nlm.nih.gov/pubmed/35396385
http://dx.doi.org/10.1038/s41746-022-00588-8
work_keys_str_mv AT vieirafernandog amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT venugopalansubhashini amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT premasirialans amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT mcnallymaeve amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT jansenaren amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT mccloskeykevin amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT brennermichaelp amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT perrinsteven amachinelearningbasedobjectivemeasureforalsdiseaseseverity
AT vieirafernandog machinelearningbasedobjectivemeasureforalsdiseaseseverity
AT venugopalansubhashini machinelearningbasedobjectivemeasureforalsdiseaseseverity
AT premasirialans machinelearningbasedobjectivemeasureforalsdiseaseseverity
AT mcnallymaeve machinelearningbasedobjectivemeasureforalsdiseaseseverity
AT jansenaren machinelearningbasedobjectivemeasureforalsdiseaseseverity
AT mccloskeykevin machinelearningbasedobjectivemeasureforalsdiseaseseverity
AT brennermichaelp machinelearningbasedobjectivemeasureforalsdiseaseseverity
AT perrinsteven machinelearningbasedobjectivemeasureforalsdiseaseseverity