Cargando…

The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction

Prediction of post-stroke functional outcomes is crucial for allocating medical resources. In this study, a total of 577 patients were enrolled in the Post-Acute Care-Cerebrovascular Disease (PAC-CVD) program, and 77 predictors were collected at admission. The outcome was whether a patient could ach...

Descripción completa

Detalles Bibliográficos
Autores principales: Chang, Shih-Chieh, Chu, Chan-Lin, Chen, Chih-Kuang, Chang, Hsiang-Ning, Wong, Alice M. K., Chen, Yueh-Peng, Pei, Yu-Cheng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8534424/
https://www.ncbi.nlm.nih.gov/pubmed/34679482
http://dx.doi.org/10.3390/diagnostics11101784
_version_ 1784587549502603264
author Chang, Shih-Chieh
Chu, Chan-Lin
Chen, Chih-Kuang
Chang, Hsiang-Ning
Wong, Alice M. K.
Chen, Yueh-Peng
Pei, Yu-Cheng
author_facet Chang, Shih-Chieh
Chu, Chan-Lin
Chen, Chih-Kuang
Chang, Hsiang-Ning
Wong, Alice M. K.
Chen, Yueh-Peng
Pei, Yu-Cheng
author_sort Chang, Shih-Chieh
collection PubMed
description Prediction of post-stroke functional outcomes is crucial for allocating medical resources. In this study, a total of 577 patients were enrolled in the Post-Acute Care-Cerebrovascular Disease (PAC-CVD) program, and 77 predictors were collected at admission. The outcome was whether a patient could achieve a Barthel Index (BI) score of >60 upon discharge. Eight machine-learning (ML) methods were applied, and their results were integrated by stacking method. The area under the curve (AUC) of the eight ML models ranged from 0.83 to 0.887, with random forest, stacking, logistic regression, and support vector machine demonstrating superior performance. The feature importance analysis indicated that the initial Berg Balance Test (BBS-I), initial BI (BI-I), and initial Concise Chinese Aphasia Test (CCAT-I) were the top three predictors of BI scores at discharge. The partial dependence plot (PDP) and individual conditional expectation (ICE) plot indicated that the predictors’ ability to predict outcomes was the most pronounced within a specific value range (e.g., BBS-I < 40 and BI-I < 60). BI at discharge could be predicted by information collected at admission with the aid of various ML models, and the PDP and ICE plots indicated that the predictors could predict outcomes at a certain value range.
format Online
Article
Text
id pubmed-8534424
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-85344242021-10-23 The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction Chang, Shih-Chieh Chu, Chan-Lin Chen, Chih-Kuang Chang, Hsiang-Ning Wong, Alice M. K. Chen, Yueh-Peng Pei, Yu-Cheng Diagnostics (Basel) Article Prediction of post-stroke functional outcomes is crucial for allocating medical resources. In this study, a total of 577 patients were enrolled in the Post-Acute Care-Cerebrovascular Disease (PAC-CVD) program, and 77 predictors were collected at admission. The outcome was whether a patient could achieve a Barthel Index (BI) score of >60 upon discharge. Eight machine-learning (ML) methods were applied, and their results were integrated by stacking method. The area under the curve (AUC) of the eight ML models ranged from 0.83 to 0.887, with random forest, stacking, logistic regression, and support vector machine demonstrating superior performance. The feature importance analysis indicated that the initial Berg Balance Test (BBS-I), initial BI (BI-I), and initial Concise Chinese Aphasia Test (CCAT-I) were the top three predictors of BI scores at discharge. The partial dependence plot (PDP) and individual conditional expectation (ICE) plot indicated that the predictors’ ability to predict outcomes was the most pronounced within a specific value range (e.g., BBS-I < 40 and BI-I < 60). BI at discharge could be predicted by information collected at admission with the aid of various ML models, and the PDP and ICE plots indicated that the predictors could predict outcomes at a certain value range. MDPI 2021-09-28 /pmc/articles/PMC8534424/ /pubmed/34679482 http://dx.doi.org/10.3390/diagnostics11101784 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chang, Shih-Chieh
Chu, Chan-Lin
Chen, Chih-Kuang
Chang, Hsiang-Ning
Wong, Alice M. K.
Chen, Yueh-Peng
Pei, Yu-Cheng
The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction
title The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction
title_full The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction
title_fullStr The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction
title_full_unstemmed The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction
title_short The Comparison and Interpretation of Machine-Learning Models in Post-Stroke Functional Outcome Prediction
title_sort comparison and interpretation of machine-learning models in post-stroke functional outcome prediction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8534424/
https://www.ncbi.nlm.nih.gov/pubmed/34679482
http://dx.doi.org/10.3390/diagnostics11101784
work_keys_str_mv AT changshihchieh thecomparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT chuchanlin thecomparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT chenchihkuang thecomparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT changhsiangning thecomparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT wongalicemk thecomparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT chenyuehpeng thecomparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT peiyucheng thecomparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT changshihchieh comparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT chuchanlin comparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT chenchihkuang comparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT changhsiangning comparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT wongalicemk comparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT chenyuehpeng comparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction
AT peiyucheng comparisonandinterpretationofmachinelearningmodelsinpoststrokefunctionaloutcomeprediction