Cargando…
Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study
BACKGROUND: Life-threatening ventricular arrhythmias (LTVAs) are main causes of sudden cardiac arrest and are highly associated with an increased risk of mortality. A prediction model that enables early identification of the high-risk individuals is still lacking. OBJECTIVE: We aimed to build machin...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10687678/ https://www.ncbi.nlm.nih.gov/pubmed/37966870 http://dx.doi.org/10.2196/47664 |
_version_ | 1785152023576969216 |
---|---|
author | Li, Le Ding, Ligang Zhang, Zhuxin Zhou, Likun Zhang, Zhenhao Xiong, Yulong Hu, Zhao Yao, Yan |
author_facet | Li, Le Ding, Ligang Zhang, Zhuxin Zhou, Likun Zhang, Zhenhao Xiong, Yulong Hu, Zhao Yao, Yan |
author_sort | Li, Le |
collection | PubMed |
description | BACKGROUND: Life-threatening ventricular arrhythmias (LTVAs) are main causes of sudden cardiac arrest and are highly associated with an increased risk of mortality. A prediction model that enables early identification of the high-risk individuals is still lacking. OBJECTIVE: We aimed to build machine learning (ML)–based models to predict in-hospital mortality in patients with LTVA. METHODS: A total of 3140 patients with LTVA were randomly divided into training (n=2512, 80%) and internal validation (n=628, 20%) sets. Moreover, data of 2851 patients from another database were collected as the external validation set. The primary output was the probability of in-hospital mortality. The discriminatory ability was evaluated by the area under the receiver operating characteristic curve (AUC). The prediction performances of 5 ML algorithms were compared with 2 conventional scoring systems, namely, the simplified acute physiology score (SAPS-II) and the logistic organ dysfunction system (LODS). RESULTS: The prediction performance of the 5 ML algorithms significantly outperformed the traditional models in predicting in-hospital mortality. CatBoost showed the highest AUC of 90.5% (95% CI 87.5%-93.5%), followed by LightGBM with an AUC of 90.1% (95% CI 86.8%-93.4%). Conversely, the predictive values of SAPS-II and LODS were unsatisfactory, with AUCs of 78.0% (95% CI 71.7%-84.3%) and 74.9% (95% CI 67.2%-82.6%), respectively. The superiority of ML-based models was also shown in the external validation set. CONCLUSIONS: ML-based models could improve the predictive values of in-hospital mortality prediction for patients with LTVA compared with traditional scoring systems. |
format | Online Article Text |
id | pubmed-10687678 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-106876782023-11-30 Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study Li, Le Ding, Ligang Zhang, Zhuxin Zhou, Likun Zhang, Zhenhao Xiong, Yulong Hu, Zhao Yao, Yan J Med Internet Res Original Paper BACKGROUND: Life-threatening ventricular arrhythmias (LTVAs) are main causes of sudden cardiac arrest and are highly associated with an increased risk of mortality. A prediction model that enables early identification of the high-risk individuals is still lacking. OBJECTIVE: We aimed to build machine learning (ML)–based models to predict in-hospital mortality in patients with LTVA. METHODS: A total of 3140 patients with LTVA were randomly divided into training (n=2512, 80%) and internal validation (n=628, 20%) sets. Moreover, data of 2851 patients from another database were collected as the external validation set. The primary output was the probability of in-hospital mortality. The discriminatory ability was evaluated by the area under the receiver operating characteristic curve (AUC). The prediction performances of 5 ML algorithms were compared with 2 conventional scoring systems, namely, the simplified acute physiology score (SAPS-II) and the logistic organ dysfunction system (LODS). RESULTS: The prediction performance of the 5 ML algorithms significantly outperformed the traditional models in predicting in-hospital mortality. CatBoost showed the highest AUC of 90.5% (95% CI 87.5%-93.5%), followed by LightGBM with an AUC of 90.1% (95% CI 86.8%-93.4%). Conversely, the predictive values of SAPS-II and LODS were unsatisfactory, with AUCs of 78.0% (95% CI 71.7%-84.3%) and 74.9% (95% CI 67.2%-82.6%), respectively. The superiority of ML-based models was also shown in the external validation set. CONCLUSIONS: ML-based models could improve the predictive values of in-hospital mortality prediction for patients with LTVA compared with traditional scoring systems. JMIR Publications 2023-11-15 /pmc/articles/PMC10687678/ /pubmed/37966870 http://dx.doi.org/10.2196/47664 Text en ©Le Li, Ligang Ding, Zhuxin Zhang, Likun Zhou, Zhenhao Zhang, Yulong Xiong, Zhao Hu, Yan Yao. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 15.11.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Li, Le Ding, Ligang Zhang, Zhuxin Zhou, Likun Zhang, Zhenhao Xiong, Yulong Hu, Zhao Yao, Yan Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study |
title | Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study |
title_full | Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study |
title_fullStr | Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study |
title_full_unstemmed | Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study |
title_short | Development and Validation of Machine Learning–Based Models to Predict In-Hospital Mortality in Life-Threatening Ventricular Arrhythmias: Retrospective Cohort Study |
title_sort | development and validation of machine learning–based models to predict in-hospital mortality in life-threatening ventricular arrhythmias: retrospective cohort study |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10687678/ https://www.ncbi.nlm.nih.gov/pubmed/37966870 http://dx.doi.org/10.2196/47664 |
work_keys_str_mv | AT lile developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy AT dingligang developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy AT zhangzhuxin developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy AT zhoulikun developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy AT zhangzhenhao developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy AT xiongyulong developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy AT huzhao developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy AT yaoyan developmentandvalidationofmachinelearningbasedmodelstopredictinhospitalmortalityinlifethreateningventriculararrhythmiasretrospectivecohortstudy |