Cargando…

Early prediction of MODS interventions in the intensive care unit using machine learning

BACKGROUND: Multiple organ dysfunction syndrome (MODS) is one of the leading causes of death in critically ill patients. MODS is the result of a dysregulated inflammatory response that can be triggered by various causes. Owing to the lack of an effective treatment for patients with MODS, early ident...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Chang, Yao, Zhenjie, Liu, Pengfei, Tu, Yanhui, Chen, Hu, Cheng, Haibo, Xie, Lixin, Xiao, Kun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10158675/
https://www.ncbi.nlm.nih.gov/pubmed/37193361
http://dx.doi.org/10.1186/s40537-023-00719-2
_version_ 1785036978373263360
author Liu, Chang
Yao, Zhenjie
Liu, Pengfei
Tu, Yanhui
Chen, Hu
Cheng, Haibo
Xie, Lixin
Xiao, Kun
author_facet Liu, Chang
Yao, Zhenjie
Liu, Pengfei
Tu, Yanhui
Chen, Hu
Cheng, Haibo
Xie, Lixin
Xiao, Kun
author_sort Liu, Chang
collection PubMed
description BACKGROUND: Multiple organ dysfunction syndrome (MODS) is one of the leading causes of death in critically ill patients. MODS is the result of a dysregulated inflammatory response that can be triggered by various causes. Owing to the lack of an effective treatment for patients with MODS, early identification and intervention are the most effective strategies. Therefore, we have developed a variety of early warning models whose prediction results can be interpreted by Kernel SHapley Additive exPlanations (Kernel-SHAP) and reversed by diverse counterfactual explanations (DiCE). So we can predict the probability of MODS 12 h in advance, quantify the risk factors, and automatically recommend relevant interventions. METHODS: We used various machine learning algorithms to complete the early risk assessment of MODS, and used a stacked ensemble to improve the prediction performance. The kernel-SHAP algorithm was used to quantify the positive and minus factors corresponding to the individual prediction results, and finally, the DiCE method was used to automatically recommend interventions. We completed the model training and testing based on the MIMIC-III and MIMIC-IV databases, in which the sample features in the model training included the patients’ vital signs, laboratory test results, test reports, and data related to the use of ventilators. RESULTS: The customizable model called SuperLearner, which integrated multiple machine learning algorithms, had the highest authenticity of screening, and its Yordon index (YI), sensitivity, accuracy, and utility_score on the MIMIC-IV test set were 0.813, 0.884, 0.893, and 0.763, respectively, which were all maximum values of eleven models. The area under the curve of the deep–wide neural network (DWNN) model on the MIMIC-IV test set was 0.960, and the specificity was 0.935, which were both the maximum values of all these models. The Kernel-SHAP algorithm combined with SuperLearner was used to determine the minimum value of glasgow coma scale (GCS) in the current hour (OR = 0.609, 95% CI   0.606–0.612), maximum value of MODS score corresponding to GCS in the past 24 h (OR = 2.632, 95% CI 2.588–2.676), and maximum score of MODS corresponding to creatinine in the past 24 h (OR = 3.281, 95% CI   3.267–3.295) were generally the most influential factors. CONCLUSION: The MODS early warning model based on machine learning algorithms has considerable application value, and the prediction efficiency of SuperLearner is superior to those of SubSuperLearner, DWNN, and other eight common machine learning models. Considering that the attribution analysis of Kernel-SHAP is a static analysis of the prediction results, we introduce the DiCE algorithm to automatically recommend counterfactuals to reverse the prediction results, which will be an important step towards the practical application of automatic MODS early intervention. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40537-023-00719-2.
format Online
Article
Text
id pubmed-10158675
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-101586752023-05-09 Early prediction of MODS interventions in the intensive care unit using machine learning Liu, Chang Yao, Zhenjie Liu, Pengfei Tu, Yanhui Chen, Hu Cheng, Haibo Xie, Lixin Xiao, Kun J Big Data Research BACKGROUND: Multiple organ dysfunction syndrome (MODS) is one of the leading causes of death in critically ill patients. MODS is the result of a dysregulated inflammatory response that can be triggered by various causes. Owing to the lack of an effective treatment for patients with MODS, early identification and intervention are the most effective strategies. Therefore, we have developed a variety of early warning models whose prediction results can be interpreted by Kernel SHapley Additive exPlanations (Kernel-SHAP) and reversed by diverse counterfactual explanations (DiCE). So we can predict the probability of MODS 12 h in advance, quantify the risk factors, and automatically recommend relevant interventions. METHODS: We used various machine learning algorithms to complete the early risk assessment of MODS, and used a stacked ensemble to improve the prediction performance. The kernel-SHAP algorithm was used to quantify the positive and minus factors corresponding to the individual prediction results, and finally, the DiCE method was used to automatically recommend interventions. We completed the model training and testing based on the MIMIC-III and MIMIC-IV databases, in which the sample features in the model training included the patients’ vital signs, laboratory test results, test reports, and data related to the use of ventilators. RESULTS: The customizable model called SuperLearner, which integrated multiple machine learning algorithms, had the highest authenticity of screening, and its Yordon index (YI), sensitivity, accuracy, and utility_score on the MIMIC-IV test set were 0.813, 0.884, 0.893, and 0.763, respectively, which were all maximum values of eleven models. The area under the curve of the deep–wide neural network (DWNN) model on the MIMIC-IV test set was 0.960, and the specificity was 0.935, which were both the maximum values of all these models. The Kernel-SHAP algorithm combined with SuperLearner was used to determine the minimum value of glasgow coma scale (GCS) in the current hour (OR = 0.609, 95% CI   0.606–0.612), maximum value of MODS score corresponding to GCS in the past 24 h (OR = 2.632, 95% CI 2.588–2.676), and maximum score of MODS corresponding to creatinine in the past 24 h (OR = 3.281, 95% CI   3.267–3.295) were generally the most influential factors. CONCLUSION: The MODS early warning model based on machine learning algorithms has considerable application value, and the prediction efficiency of SuperLearner is superior to those of SubSuperLearner, DWNN, and other eight common machine learning models. Considering that the attribution analysis of Kernel-SHAP is a static analysis of the prediction results, we introduce the DiCE algorithm to automatically recommend counterfactuals to reverse the prediction results, which will be an important step towards the practical application of automatic MODS early intervention. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40537-023-00719-2. Springer International Publishing 2023-05-04 2023 /pmc/articles/PMC10158675/ /pubmed/37193361 http://dx.doi.org/10.1186/s40537-023-00719-2 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Research
Liu, Chang
Yao, Zhenjie
Liu, Pengfei
Tu, Yanhui
Chen, Hu
Cheng, Haibo
Xie, Lixin
Xiao, Kun
Early prediction of MODS interventions in the intensive care unit using machine learning
title Early prediction of MODS interventions in the intensive care unit using machine learning
title_full Early prediction of MODS interventions in the intensive care unit using machine learning
title_fullStr Early prediction of MODS interventions in the intensive care unit using machine learning
title_full_unstemmed Early prediction of MODS interventions in the intensive care unit using machine learning
title_short Early prediction of MODS interventions in the intensive care unit using machine learning
title_sort early prediction of mods interventions in the intensive care unit using machine learning
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10158675/
https://www.ncbi.nlm.nih.gov/pubmed/37193361
http://dx.doi.org/10.1186/s40537-023-00719-2
work_keys_str_mv AT liuchang earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning
AT yaozhenjie earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning
AT liupengfei earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning
AT tuyanhui earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning
AT chenhu earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning
AT chenghaibo earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning
AT xielixin earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning
AT xiaokun earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning