Cargando…

Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry

SUMMARY FOR SOCIAL MEDIA: @AliciaCastongu2, @FazalZaidi9, @oozaidat, @Mouhammad_Jumaa OBJECTIVE: Machine learning (ML) algorithms have emerged as powerful predictive tools in the field stroke. Here, we examine the predictive accuracy of ML models for predicting functional outcomes using 24‐hour post...

Descripción completa

Detalles Bibliográficos
Autores principales: Castonguay, Alicia C., Zoghi, Zeinab, Zaidat, Osama O., Burgess, Richard E., Zaidi, Syed F., Mueller‐Kronast, Nils, Liebeskind, David S., Jumaa, Mouhammad A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley & Sons, Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10091739/
https://www.ncbi.nlm.nih.gov/pubmed/36214566
http://dx.doi.org/10.1002/ana.26528
_version_ 1785023189489811456
author Castonguay, Alicia C.
Zoghi, Zeinab
Zaidat, Osama O.
Burgess, Richard E.
Zaidi, Syed F.
Mueller‐Kronast, Nils
Liebeskind, David S.
Jumaa, Mouhammad A.
author_facet Castonguay, Alicia C.
Zoghi, Zeinab
Zaidat, Osama O.
Burgess, Richard E.
Zaidi, Syed F.
Mueller‐Kronast, Nils
Liebeskind, David S.
Jumaa, Mouhammad A.
author_sort Castonguay, Alicia C.
collection PubMed
description SUMMARY FOR SOCIAL MEDIA: @AliciaCastongu2, @FazalZaidi9, @oozaidat, @Mouhammad_Jumaa OBJECTIVE: Machine learning (ML) algorithms have emerged as powerful predictive tools in the field stroke. Here, we examine the predictive accuracy of ML models for predicting functional outcomes using 24‐hour post‐treatment characteristics in the Systematic Evaluation of Patients Treated With Neurothrombectomy Devices for Acute Ischemic Stroke (STRATIS) Registry. METHODS: ML models, adaptive boost, random forest (RF), classification and regression trees (CART), C5.0 decision tree (C5.0), support vector machine (SVM), least absolute shrinkage and selection operator (LASSO), and logistic regression (LR), and traditional LR models were used to predict 90‐day functional outcome (modified Rankin Scale score 0–2). Twenty‐four‐hour National Institutes of Health Stroke Scale (NIHSS) was examined as a continuous or dichotomous variable in all models. Model accuracy was assessed using the area under characteristic curve (AUC). RESULTS: The 24‐hour NIHSS score was a top‐predictor of functional outcome in all models. ML models using the continuous 24‐hour NIHSS scored showed moderate‐to‐good predictive performance (range mean AUC: 0.76–0.92); however, RF (AUC: 0.92 ± 0.028) outperformed all ML models, except LASSO (AUC: 0.89 ± 0.023, p = 0.0958). Importantly, RF demonstrated a significantly higher predictive value than LR (AUC: 0.87 ± 0.031, p = 0.048) and traditional LR (AUC: 85 ± 0.06, p = 0.035) when using the 24‐hour continuous NIHSS score. Predictive accuracy was similar between the 24‐hour NIHSS score dichotomous and continuous ML models. INTERPRETATION: In this substudy, we found similar predictive accuracy for functional outcome when using the 24‐hour NIHSS score as a continuous or dichotomous variable in ML models. ML models had moderate‐to‐good predictive accuracy, with RF outperforming LR models. External validation of these ML models is warranted. ANN NEUROL 2023;93:40–49
format Online
Article
Text
id pubmed-10091739
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher John Wiley & Sons, Inc.
record_format MEDLINE/PubMed
spelling pubmed-100917392023-04-13 Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry Castonguay, Alicia C. Zoghi, Zeinab Zaidat, Osama O. Burgess, Richard E. Zaidi, Syed F. Mueller‐Kronast, Nils Liebeskind, David S. Jumaa, Mouhammad A. Ann Neurol Research Articles SUMMARY FOR SOCIAL MEDIA: @AliciaCastongu2, @FazalZaidi9, @oozaidat, @Mouhammad_Jumaa OBJECTIVE: Machine learning (ML) algorithms have emerged as powerful predictive tools in the field stroke. Here, we examine the predictive accuracy of ML models for predicting functional outcomes using 24‐hour post‐treatment characteristics in the Systematic Evaluation of Patients Treated With Neurothrombectomy Devices for Acute Ischemic Stroke (STRATIS) Registry. METHODS: ML models, adaptive boost, random forest (RF), classification and regression trees (CART), C5.0 decision tree (C5.0), support vector machine (SVM), least absolute shrinkage and selection operator (LASSO), and logistic regression (LR), and traditional LR models were used to predict 90‐day functional outcome (modified Rankin Scale score 0–2). Twenty‐four‐hour National Institutes of Health Stroke Scale (NIHSS) was examined as a continuous or dichotomous variable in all models. Model accuracy was assessed using the area under characteristic curve (AUC). RESULTS: The 24‐hour NIHSS score was a top‐predictor of functional outcome in all models. ML models using the continuous 24‐hour NIHSS scored showed moderate‐to‐good predictive performance (range mean AUC: 0.76–0.92); however, RF (AUC: 0.92 ± 0.028) outperformed all ML models, except LASSO (AUC: 0.89 ± 0.023, p = 0.0958). Importantly, RF demonstrated a significantly higher predictive value than LR (AUC: 0.87 ± 0.031, p = 0.048) and traditional LR (AUC: 85 ± 0.06, p = 0.035) when using the 24‐hour continuous NIHSS score. Predictive accuracy was similar between the 24‐hour NIHSS score dichotomous and continuous ML models. INTERPRETATION: In this substudy, we found similar predictive accuracy for functional outcome when using the 24‐hour NIHSS score as a continuous or dichotomous variable in ML models. ML models had moderate‐to‐good predictive accuracy, with RF outperforming LR models. External validation of these ML models is warranted. ANN NEUROL 2023;93:40–49 John Wiley & Sons, Inc. 2022-10-29 2023-01 /pmc/articles/PMC10091739/ /pubmed/36214566 http://dx.doi.org/10.1002/ana.26528 Text en © 2022 The Authors. Annals of Neurology published by Wiley Periodicals LLC on behalf of American Neurological Association. https://creativecommons.org/licenses/by-nc/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.
spellingShingle Research Articles
Castonguay, Alicia C.
Zoghi, Zeinab
Zaidat, Osama O.
Burgess, Richard E.
Zaidi, Syed F.
Mueller‐Kronast, Nils
Liebeskind, David S.
Jumaa, Mouhammad A.
Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry
title Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry
title_full Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry
title_fullStr Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry
title_full_unstemmed Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry
title_short Predicting Functional Outcome Using 24‐Hour Post‐Treatment Characteristics: Application of Machine Learning Algorithms in the STRATIS Registry
title_sort predicting functional outcome using 24‐hour post‐treatment characteristics: application of machine learning algorithms in the stratis registry
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10091739/
https://www.ncbi.nlm.nih.gov/pubmed/36214566
http://dx.doi.org/10.1002/ana.26528
work_keys_str_mv AT castonguayaliciac predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry
AT zoghizeinab predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry
AT zaidatosamao predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry
AT burgessricharde predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry
AT zaidisyedf predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry
AT muellerkronastnils predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry
AT liebeskinddavids predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry
AT jumaamouhammada predictingfunctionaloutcomeusing24hourposttreatmentcharacteristicsapplicationofmachinelearningalgorithmsinthestratisregistry