Cargando…

Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study

BACKGROUND: Life-threatening ventricular arrhythmias (LTVAs) are main causes of sudden cardiac arrest and are highly associated with an increased risk of mortality. A prediction model that enables early identification of the high-risk individuals is still lacking. OBJECTIVE: We aimed to build machin...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Le, Ding, Ligang, Zhang, Zhuxin, Zhou, Likun, Zhang, Zhenhao, Xiong, Yulong, Hu, Zhao, Yao, Yan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10687678/
https://www.ncbi.nlm.nih.gov/pubmed/37966870
http://dx.doi.org/10.2196/47664
_version_ 1785152023576969216
author Li, Le
Ding, Ligang
Zhang, Zhuxin
Zhou, Likun
Zhang, Zhenhao
Xiong, Yulong
Hu, Zhao
Yao, Yan
author_facet Li, Le
Ding, Ligang
Zhang, Zhuxin
Zhou, Likun
Zhang, Zhenhao
Xiong, Yulong
Hu, Zhao
Yao, Yan
author_sort Li, Le
collection PubMed
description BACKGROUND: Life-threatening ventricular arrhythmias (LTVAs) are main causes of sudden cardiac arrest and are highly associated with an increased risk of mortality. A prediction model that enables early identification of the high-risk individuals is still lacking. OBJECTIVE: We aimed to build machine learning (ML)–based models to predict in-hospital mortality in patients with LTVA. METHODS: A total of 3140 patients with LTVA were randomly divided into training (n=2512, 80%) and internal validation (n=628, 20%) sets. Moreover, data of 2851 patients from another database were collected as the external validation set. The primary output was the probability of in-hospital mortality. The discriminatory ability was evaluated by the area under the receiver operating characteristic curve (AUC). The prediction performances of 5 ML algorithms were compared with 2 conventional scoring systems, namely, the simplified acute physiology score (SAPS-II) and the logistic organ dysfunction system (LODS). RESULTS: The prediction performance of the 5 ML algorithms significantly outperformed the traditional models in predicting in-hospital mortality. CatBoost showed the highest AUC of 90.5% (95% CI 87.5%-93.5%), followed by LightGBM with an AUC of 90.1% (95% CI 86.8%-93.4%). Conversely, the predictive values of SAPS-II and LODS were unsatisfactory, with AUCs of 78.0% (95% CI 71.7%-84.3%) and 74.9% (95% CI 67.2%-82.6%), respectively. The superiority of ML-based models was also shown in the external validation set. CONCLUSIONS: ML-based models could improve the predictive values of in-hospital mortality prediction for patients with LTVA compared with traditional scoring systems.
format Online
Article
Text
id pubmed-10687678
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-106876782023-11-30 Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study Li, Le Ding, Ligang Zhang, Zhuxin Zhou, Likun Zhang, Zhenhao Xiong, Yulong Hu, Zhao Yao, Yan J Med Internet Res Original Paper BACKGROUND: Life-threatening ventricular arrhythmias (LTVAs) are main causes of sudden cardiac arrest and are highly associated with an increased risk of mortality. A prediction model that enables early identification of the high-risk individuals is still lacking. OBJECTIVE: We aimed to build machine learning (ML)–based models to predict in-hospital mortality in patients with LTVA. METHODS: A total of 3140 patients with LTVA were randomly divided into training (n=2512, 80%) and internal validation (n=628, 20%) sets. Moreover, data of 2851 patients from another database were collected as the external validation set. The primary output was the probability of in-hospital mortality. The discriminatory ability was evaluated by the area under the receiver operating characteristic curve (AUC). The prediction performances of 5 ML algorithms were compared with 2 conventional scoring systems, namely, the simplified acute physiology score (SAPS-II) and the logistic organ dysfunction system (LODS). RESULTS: The prediction performance of the 5 ML algorithms significantly outperformed the traditional models in predicting in-hospital mortality. CatBoost showed the highest AUC of 90.5% (95% CI 87.5%-93.5%), followed by LightGBM with an AUC of 90.1% (95% CI 86.8%-93.4%). Conversely, the predictive values of SAPS-II and LODS were unsatisfactory, with AUCs of 78.0% (95% CI 71.7%-84.3%) and 74.9% (95% CI 67.2%-82.6%), respectively. The superiority of ML-based models was also shown in the external validation set. CONCLUSIONS: ML-based models could improve the predictive values of in-hospital mortality prediction for patients with LTVA compared with traditional scoring systems. JMIR Publications 2023-11-15 /pmc/articles/PMC10687678/ /pubmed/37966870 http://dx.doi.org/10.2196/47664 Text en ©Le Li, Ligang Ding, Zhuxin Zhang, Likun Zhou, Zhenhao Zhang, Yulong Xiong, Zhao Hu, Yan Yao. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 15.11.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Li, Le
Ding, Ligang
Zhang, Zhuxin
Zhou, Likun
Zhang, Zhenhao
Xiong, Yulong
Hu, Zhao
Yao, Yan
Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study
title Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study
title_full Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study
title_fullStr Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study
title_full_unstemmed Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study
title_short Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study
title_sort development and validation of machine learning–based models to predict in-hospital mortality in life-threatening ventricular arrhythmias: retrospective cohort study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10687678/
https://www.ncbi.nlm.nih.gov/pubmed/37966870
http://dx.doi.org/10.2196/47664
work_keys_str_mv AT lile developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy
AT dingligang developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy
AT zhangzhuxin developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy
AT zhoulikun developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy
AT zhangzhenhao developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy
AT xiongyulong developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy
AT huzhao developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy
AT yaoyan developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy