Cargando…

The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis

BACKGROUND: Machine learning is a potentially effective method for identifying and predicting the time of the onset of stroke. However, the value of applying machine learning in this field remains controversial and debatable. OBJECTIVE: We aimed to assess the value of applying machine learning in pr...

Descripción completa

Detalles Bibliográficos
Autores principales: Feng, Jing, Zhang, Qizhi, Wu, Feng, Peng, Jinxiang, Li, Ziwei, Chen, Zhuang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10603565/
https://www.ncbi.nlm.nih.gov/pubmed/37824198
http://dx.doi.org/10.2196/44895
_version_ 1785126632507310080
author Feng, Jing
Zhang, Qizhi
Wu, Feng
Peng, Jinxiang
Li, Ziwei
Chen, Zhuang
author_facet Feng, Jing
Zhang, Qizhi
Wu, Feng
Peng, Jinxiang
Li, Ziwei
Chen, Zhuang
author_sort Feng, Jing
collection PubMed
description BACKGROUND: Machine learning is a potentially effective method for identifying and predicting the time of the onset of stroke. However, the value of applying machine learning in this field remains controversial and debatable. OBJECTIVE: We aimed to assess the value of applying machine learning in predicting the time of stroke onset. METHODS: PubMed, Web of Science, Embase, and Cochrane were comprehensively searched. The C index and sensitivity with 95% CI were used as effect sizes. The risk of bias was evaluated using PROBAST (Prediction Model Risk of Bias Assessment Tool), and meta-analysis was conducted using R (version 4.2.0; R Core Team). RESULTS: Thirteen eligible studies were included in the meta-analysis involving 55 machine learning models with 41 models in the training set and 14 in the validation set. The overall C index was 0.800 (95% CI 0.773-0.826) in the training set and 0.781 (95% CI 0.709-0.852) in the validation set. The sensitivity and specificity were 0.76 (95% CI 0.73-0.80) and 0.79 (95% CI 0.74-0.82) in the training set and 0.81 (95% CI 0.68-0.90) and 0.83 (95% CI 0.73-0.89) in the validation set, respectively. Subgroup analysis revealed that the accuracy of machine learning in predicting the time of stroke onset within 4.5 hours was optimal (training: 0.80, 95% CI 0.77-0.83; validation: 0.79, 95% CI 0.71-0.86). CONCLUSIONS: Machine learning has ideal performance in identifying the time of stroke onset. More reasonable image segmentation and texture extraction methods in radiomics should be used to promote the value of applying machine learning in diverse ethnic backgrounds. TRIAL REGISTRATION: PROSPERO CRD42022358898; https://www.crd.york.ac.uk/Prospero/display_record.php?RecordID=358898
format Online
Article
Text
id pubmed-10603565
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-106035652023-10-28 The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis Feng, Jing Zhang, Qizhi Wu, Feng Peng, Jinxiang Li, Ziwei Chen, Zhuang J Med Internet Res Review BACKGROUND: Machine learning is a potentially effective method for identifying and predicting the time of the onset of stroke. However, the value of applying machine learning in this field remains controversial and debatable. OBJECTIVE: We aimed to assess the value of applying machine learning in predicting the time of stroke onset. METHODS: PubMed, Web of Science, Embase, and Cochrane were comprehensively searched. The C index and sensitivity with 95% CI were used as effect sizes. The risk of bias was evaluated using PROBAST (Prediction Model Risk of Bias Assessment Tool), and meta-analysis was conducted using R (version 4.2.0; R Core Team). RESULTS: Thirteen eligible studies were included in the meta-analysis involving 55 machine learning models with 41 models in the training set and 14 in the validation set. The overall C index was 0.800 (95% CI 0.773-0.826) in the training set and 0.781 (95% CI 0.709-0.852) in the validation set. The sensitivity and specificity were 0.76 (95% CI 0.73-0.80) and 0.79 (95% CI 0.74-0.82) in the training set and 0.81 (95% CI 0.68-0.90) and 0.83 (95% CI 0.73-0.89) in the validation set, respectively. Subgroup analysis revealed that the accuracy of machine learning in predicting the time of stroke onset within 4.5 hours was optimal (training: 0.80, 95% CI 0.77-0.83; validation: 0.79, 95% CI 0.71-0.86). CONCLUSIONS: Machine learning has ideal performance in identifying the time of stroke onset. More reasonable image segmentation and texture extraction methods in radiomics should be used to promote the value of applying machine learning in diverse ethnic backgrounds. TRIAL REGISTRATION: PROSPERO CRD42022358898; https://www.crd.york.ac.uk/Prospero/display_record.php?RecordID=358898 JMIR Publications 2023-10-12 /pmc/articles/PMC10603565/ /pubmed/37824198 http://dx.doi.org/10.2196/44895 Text en ©Jing Feng, Qizhi Zhang, Feng Wu, Jinxiang Peng, Ziwei Li, Zhuang Chen. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 12.10.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Review
Feng, Jing
Zhang, Qizhi
Wu, Feng
Peng, Jinxiang
Li, Ziwei
Chen, Zhuang
The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis
title The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis
title_full The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis
title_fullStr The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis
title_full_unstemmed The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis
title_short The Value of Applying Machine Learning in Predicting the Time of Symptom Onset in Stroke Patients: Systematic Review and Meta-Analysis
title_sort value of applying machine learning in predicting the time of symptom onset in stroke patients: systematic review and meta-analysis
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10603565/
https://www.ncbi.nlm.nih.gov/pubmed/37824198
http://dx.doi.org/10.2196/44895
work_keys_str_mv AT fengjing thevalueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT zhangqizhi thevalueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT wufeng thevalueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT pengjinxiang thevalueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT liziwei thevalueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT chenzhuang thevalueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT fengjing valueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT zhangqizhi valueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT wufeng valueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT pengjinxiang valueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT liziwei valueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis
AT chenzhuang valueofapplyingmachinelearninginpredictingthetimeofsymptomonsetinstrokepatientssystematicreviewandmetaanalysis