Cargando…
Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry
SUMMARY FOR SOCIAL MEDIA: @AliciaCastongu2, @FazalZaidi9, @oozaidat, @Mouhammad_Jumaa OBJECTIVE: Machine learning (ML) algorithms have emerged as powerful predictive tools in the field stroke. Here, we examine the predictive accuracy of ML models for predicting functional outcomes using 24‐hour post...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley & Sons, Inc.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10091739/ https://www.ncbi.nlm.nih.gov/pubmed/36214566 http://dx.doi.org/10.1002/ana.26528 |
_version_ | 1785023189489811456 |
---|---|
author | Castonguay, Alicia C. Zoghi, Zeinab Zaidat, Osama O. Burgess, Richard E. Zaidi, Syed F. Mueller‐Kronast, Nils Liebeskind, David S. Jumaa, Mouhammad A. |
author_facet | Castonguay, Alicia C. Zoghi, Zeinab Zaidat, Osama O. Burgess, Richard E. Zaidi, Syed F. Mueller‐Kronast, Nils Liebeskind, David S. Jumaa, Mouhammad A. |
author_sort | Castonguay, Alicia C. |
collection | PubMed |
description | SUMMARY FOR SOCIAL MEDIA: @AliciaCastongu2, @FazalZaidi9, @oozaidat, @Mouhammad_Jumaa OBJECTIVE: Machine learning (ML) algorithms have emerged as powerful predictive tools in the field stroke. Here, we examine the predictive accuracy of ML models for predicting functional outcomes using 24‐hour post‐treatment characteristics in the Systematic Evaluation of Patients Treated With Neurothrombectomy Devices for Acute Ischemic Stroke (STRATIS) Registry. METHODS: ML models, adaptive boost, random forest (RF), classification and regression trees (CART), C5.0 decision tree (C5.0), support vector machine (SVM), least absolute shrinkage and selection operator (LASSO), and logistic regression (LR), and traditional LR models were used to predict 90‐day functional outcome (modified Rankin Scale score 0–2). Twenty‐four‐hour National Institutes of Health Stroke Scale (NIHSS) was examined as a continuous or dichotomous variable in all models. Model accuracy was assessed using the area under characteristic curve (AUC). RESULTS: The 24‐hour NIHSS score was a top‐predictor of functional outcome in all models. ML models using the continuous 24‐hour NIHSS scored showed moderate‐to‐good predictive performance (range mean AUC: 0.76–0.92); however, RF (AUC: 0.92 ± 0.028) outperformed all ML models, except LASSO (AUC: 0.89 ± 0.023, p = 0.0958). Importantly, RF demonstrated a significantly higher predictive value than LR (AUC: 0.87 ± 0.031, p = 0.048) and traditional LR (AUC: 85 ± 0.06, p = 0.035) when using the 24‐hour continuous NIHSS score. Predictive accuracy was similar between the 24‐hour NIHSS score dichotomous and continuous ML models. INTERPRETATION: In this substudy, we found similar predictive accuracy for functional outcome when using the 24‐hour NIHSS score as a continuous or dichotomous variable in ML models. ML models had moderate‐to‐good predictive accuracy, with RF outperforming LR models. External validation of these ML models is warranted. ANN NEUROL 2023;93:40–49 |
format | Online Article Text |
id | pubmed-10091739 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | John Wiley & Sons, Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-100917392023-04-13 Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry Castonguay, Alicia C. Zoghi, Zeinab Zaidat, Osama O. Burgess, Richard E. Zaidi, Syed F. Mueller‐Kronast, Nils Liebeskind, David S. Jumaa, Mouhammad A. Ann Neurol Research Articles SUMMARY FOR SOCIAL MEDIA: @AliciaCastongu2, @FazalZaidi9, @oozaidat, @Mouhammad_Jumaa OBJECTIVE: Machine learning (ML) algorithms have emerged as powerful predictive tools in the field stroke. Here, we examine the predictive accuracy of ML models for predicting functional outcomes using 24‐hour post‐treatment characteristics in the Systematic Evaluation of Patients Treated With Neurothrombectomy Devices for Acute Ischemic Stroke (STRATIS) Registry. METHODS: ML models, adaptive boost, random forest (RF), classification and regression trees (CART), C5.0 decision tree (C5.0), support vector machine (SVM), least absolute shrinkage and selection operator (LASSO), and logistic regression (LR), and traditional LR models were used to predict 90‐day functional outcome (modified Rankin Scale score 0–2). Twenty‐four‐hour National Institutes of Health Stroke Scale (NIHSS) was examined as a continuous or dichotomous variable in all models. Model accuracy was assessed using the area under characteristic curve (AUC). RESULTS: The 24‐hour NIHSS score was a top‐predictor of functional outcome in all models. ML models using the continuous 24‐hour NIHSS scored showed moderate‐to‐good predictive performance (range mean AUC: 0.76–0.92); however, RF (AUC: 0.92 ± 0.028) outperformed all ML models, except LASSO (AUC: 0.89 ± 0.023, p = 0.0958). Importantly, RF demonstrated a significantly higher predictive value than LR (AUC: 0.87 ± 0.031, p = 0.048) and traditional LR (AUC: 85 ± 0.06, p = 0.035) when using the 24‐hour continuous NIHSS score. Predictive accuracy was similar between the 24‐hour NIHSS score dichotomous and continuous ML models. INTERPRETATION: In this substudy, we found similar predictive accuracy for functional outcome when using the 24‐hour NIHSS score as a continuous or dichotomous variable in ML models. ML models had moderate‐to‐good predictive accuracy, with RF outperforming LR models. External validation of these ML models is warranted. ANN NEUROL 2023;93:40–49 John Wiley & Sons, Inc. 2022-10-29 2023-01 /pmc/articles/PMC10091739/ /pubmed/36214566 http://dx.doi.org/10.1002/ana.26528 Text en © 2022 The Authors. Annals of Neurology published by Wiley Periodicals LLC on behalf of American Neurological Association. https://creativecommons.org/licenses/by-nc/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes. |
spellingShingle | Research Articles Castonguay, Alicia C. Zoghi, Zeinab Zaidat, Osama O. Burgess, Richard E. Zaidi, Syed F. Mueller‐Kronast, Nils Liebeskind, David S. Jumaa, Mouhammad A. Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry |
title | Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry |
title_full | Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry |
title_fullStr | Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry |
title_full_unstemmed | Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry |
title_short | Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry |
title_sort | predicting functional outcome using 24‐hour post‐treatment characteristics: application of machine learning algorithms in the stratis registry |
topic | Research Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10091739/ https://www.ncbi.nlm.nih.gov/pubmed/36214566 http://dx.doi.org/10.1002/ana.26528 |
work_keys_str_mv | AT castonguayaliciac predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry AT zoghizeinab predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry AT zaidatosamao predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry AT burgessricharde predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry AT zaidisyedf predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry AT muellerkronastnils predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry AT liebeskinddavids predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry AT jumaamouhammada predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry |