Cargando…
Early prediction of MODS interventions in the intensive care unit using machine learning
BACKGROUND: Multiple organ dysfunction syndrome (MODS) is one of the leading causes of death in critically ill patients. MODS is the result of a dysregulated inflammatory response that can be triggered by various causes. Owing to the lack of an effective treatment for patients with MODS, early ident...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10158675/ https://www.ncbi.nlm.nih.gov/pubmed/37193361 http://dx.doi.org/10.1186/s40537-023-00719-2 |
_version_ | 1785036978373263360 |
---|---|
author | Liu, Chang Yao, Zhenjie Liu, Pengfei Tu, Yanhui Chen, Hu Cheng, Haibo Xie, Lixin Xiao, Kun |
author_facet | Liu, Chang Yao, Zhenjie Liu, Pengfei Tu, Yanhui Chen, Hu Cheng, Haibo Xie, Lixin Xiao, Kun |
author_sort | Liu, Chang |
collection | PubMed |
description | BACKGROUND: Multiple organ dysfunction syndrome (MODS) is one of the leading causes of death in critically ill patients. MODS is the result of a dysregulated inflammatory response that can be triggered by various causes. Owing to the lack of an effective treatment for patients with MODS, early identification and intervention are the most effective strategies. Therefore, we have developed a variety of early warning models whose prediction results can be interpreted by Kernel SHapley Additive exPlanations (Kernel-SHAP) and reversed by diverse counterfactual explanations (DiCE). So we can predict the probability of MODS 12 h in advance, quantify the risk factors, and automatically recommend relevant interventions. METHODS: We used various machine learning algorithms to complete the early risk assessment of MODS, and used a stacked ensemble to improve the prediction performance. The kernel-SHAP algorithm was used to quantify the positive and minus factors corresponding to the individual prediction results, and finally, the DiCE method was used to automatically recommend interventions. We completed the model training and testing based on the MIMIC-III and MIMIC-IV databases, in which the sample features in the model training included the patients’ vital signs, laboratory test results, test reports, and data related to the use of ventilators. RESULTS: The customizable model called SuperLearner, which integrated multiple machine learning algorithms, had the highest authenticity of screening, and its Yordon index (YI), sensitivity, accuracy, and utility_score on the MIMIC-IV test set were 0.813, 0.884, 0.893, and 0.763, respectively, which were all maximum values of eleven models. The area under the curve of the deep–wide neural network (DWNN) model on the MIMIC-IV test set was 0.960, and the specificity was 0.935, which were both the maximum values of all these models. The Kernel-SHAP algorithm combined with SuperLearner was used to determine the minimum value of glasgow coma scale (GCS) in the current hour (OR = 0.609, 95% CI 0.606–0.612), maximum value of MODS score corresponding to GCS in the past 24 h (OR = 2.632, 95% CI 2.588–2.676), and maximum score of MODS corresponding to creatinine in the past 24 h (OR = 3.281, 95% CI 3.267–3.295) were generally the most influential factors. CONCLUSION: The MODS early warning model based on machine learning algorithms has considerable application value, and the prediction efficiency of SuperLearner is superior to those of SubSuperLearner, DWNN, and other eight common machine learning models. Considering that the attribution analysis of Kernel-SHAP is a static analysis of the prediction results, we introduce the DiCE algorithm to automatically recommend counterfactuals to reverse the prediction results, which will be an important step towards the practical application of automatic MODS early intervention. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40537-023-00719-2. |
format | Online Article Text |
id | pubmed-10158675 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-101586752023-05-09 Early prediction of MODS interventions in the intensive care unit using machine learning Liu, Chang Yao, Zhenjie Liu, Pengfei Tu, Yanhui Chen, Hu Cheng, Haibo Xie, Lixin Xiao, Kun J Big Data Research BACKGROUND: Multiple organ dysfunction syndrome (MODS) is one of the leading causes of death in critically ill patients. MODS is the result of a dysregulated inflammatory response that can be triggered by various causes. Owing to the lack of an effective treatment for patients with MODS, early identification and intervention are the most effective strategies. Therefore, we have developed a variety of early warning models whose prediction results can be interpreted by Kernel SHapley Additive exPlanations (Kernel-SHAP) and reversed by diverse counterfactual explanations (DiCE). So we can predict the probability of MODS 12 h in advance, quantify the risk factors, and automatically recommend relevant interventions. METHODS: We used various machine learning algorithms to complete the early risk assessment of MODS, and used a stacked ensemble to improve the prediction performance. The kernel-SHAP algorithm was used to quantify the positive and minus factors corresponding to the individual prediction results, and finally, the DiCE method was used to automatically recommend interventions. We completed the model training and testing based on the MIMIC-III and MIMIC-IV databases, in which the sample features in the model training included the patients’ vital signs, laboratory test results, test reports, and data related to the use of ventilators. RESULTS: The customizable model called SuperLearner, which integrated multiple machine learning algorithms, had the highest authenticity of screening, and its Yordon index (YI), sensitivity, accuracy, and utility_score on the MIMIC-IV test set were 0.813, 0.884, 0.893, and 0.763, respectively, which were all maximum values of eleven models. The area under the curve of the deep–wide neural network (DWNN) model on the MIMIC-IV test set was 0.960, and the specificity was 0.935, which were both the maximum values of all these models. The Kernel-SHAP algorithm combined with SuperLearner was used to determine the minimum value of glasgow coma scale (GCS) in the current hour (OR = 0.609, 95% CI 0.606–0.612), maximum value of MODS score corresponding to GCS in the past 24 h (OR = 2.632, 95% CI 2.588–2.676), and maximum score of MODS corresponding to creatinine in the past 24 h (OR = 3.281, 95% CI 3.267–3.295) were generally the most influential factors. CONCLUSION: The MODS early warning model based on machine learning algorithms has considerable application value, and the prediction efficiency of SuperLearner is superior to those of SubSuperLearner, DWNN, and other eight common machine learning models. Considering that the attribution analysis of Kernel-SHAP is a static analysis of the prediction results, we introduce the DiCE algorithm to automatically recommend counterfactuals to reverse the prediction results, which will be an important step towards the practical application of automatic MODS early intervention. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40537-023-00719-2. Springer International Publishing 2023-05-04 2023 /pmc/articles/PMC10158675/ /pubmed/37193361 http://dx.doi.org/10.1186/s40537-023-00719-2 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Research Liu, Chang Yao, Zhenjie Liu, Pengfei Tu, Yanhui Chen, Hu Cheng, Haibo Xie, Lixin Xiao, Kun Early prediction of MODS interventions in the intensive care unit using machine learning |
title | Early prediction of MODS interventions in the intensive care unit using machine learning |
title_full | Early prediction of MODS interventions in the intensive care unit using machine learning |
title_fullStr | Early prediction of MODS interventions in the intensive care unit using machine learning |
title_full_unstemmed | Early prediction of MODS interventions in the intensive care unit using machine learning |
title_short | Early prediction of MODS interventions in the intensive care unit using machine learning |
title_sort | early prediction of mods interventions in the intensive care unit using machine learning |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10158675/ https://www.ncbi.nlm.nih.gov/pubmed/37193361 http://dx.doi.org/10.1186/s40537-023-00719-2 |
work_keys_str_mv | AT liuchang earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning AT yaozhenjie earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning AT liupengfei earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning AT tuyanhui earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning AT chenhu earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning AT chenghaibo earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning AT xielixin earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning AT xiaokun earlypredictionofmodsinterventionsintheintensivecareunitusingmachinelearning |