Cargando…

Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission

INTRODUCTION: Septic patients requiring intensive care unit (ICU) readmission are at high risk of mortality, but research focusing on the association of ICU readmission due to sepsis and mortality is limited. The aim of this study was to develop and validate a machine learning (ML) model for predict...

Descripción completa

Detalles Bibliográficos
Autores principales: Hu, Chang, Li, Lu, Li, Yiming, Wang, Fengyun, Hu, Bo, Peng, Zhiyong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Healthcare 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9282631/
https://www.ncbi.nlm.nih.gov/pubmed/35835943
http://dx.doi.org/10.1007/s40121-022-00671-3
_version_ 1784747146441916416
author Hu, Chang
Li, Lu
Li, Yiming
Wang, Fengyun
Hu, Bo
Peng, Zhiyong
author_facet Hu, Chang
Li, Lu
Li, Yiming
Wang, Fengyun
Hu, Bo
Peng, Zhiyong
author_sort Hu, Chang
collection PubMed
description INTRODUCTION: Septic patients requiring intensive care unit (ICU) readmission are at high risk of mortality, but research focusing on the association of ICU readmission due to sepsis and mortality is limited. The aim of this study was to develop and validate a machine learning (ML) model for predicting in-hospital mortality in septic patients readmitted to the ICU using routinely available clinical data. METHODS: The data used in this study were obtained from the Medical Information Mart for Intensive Care (MIMIC-IV, v1.0) database, between 2008 and 2019. The study cohort included patients with sepsis requiring ICU readmission. The data were randomly split into a training (75%) data set and a validation (25%) data set. Nine popular ML models were developed to predict mortality in septic patients readmitted to the ICU. The model with the best accuracy and area under the curve (A.C.) in the validation cohort was defined as the optimal model and was selected for further prediction studies. The SHAPELY Additive explanations (SHAP) values and Local Interpretable Model-Agnostic Explanation (LIME) methods were used to improve the interpretability of the optimal model. RESULTS: A total of 1117 septic patients who had required ICU readmission during the study period were enrolled in the study. Of these participants, 434 (38.9%) were female, and the median (interquartile range [IQR]) age was 68.6 (58.4–79.2) years. The median (IQR) ICU interval duration was 2.60 (0.64–5.78) days. After feature selection, 31 of 47 clinical factors were ultimately chosen for use in model construction. Of the nine ML models tested, the best performance was achieved with the random forest (RF) model, with an A.C. of 0.81, an accuracy of 85% and a precision of 62% in the validation cohort. The SHAP summary analysis revealed that Glasgow Coma Scale score, urine output, blood urea nitrogen, lactate, platelet count and systolic blood pressure were the top six most important factors contributing to the RF model. Additionally, the LIME method demonstrated how the RF model works in terms of explaining risk of death prediction in septic patients requiring ICU readmission. CONCLUSION: The ML models reported here showed a good prognostic prediction ability in septic patients requiring ICU readmission. Of the features selected, the parameters related to organ perfusion made the largest contribution to outcome prediction during ICU readmission in septic patients. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s40121-022-00671-3.
format Online
Article
Text
id pubmed-9282631
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer Healthcare
record_format MEDLINE/PubMed
spelling pubmed-92826312022-07-15 Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission Hu, Chang Li, Lu Li, Yiming Wang, Fengyun Hu, Bo Peng, Zhiyong Infect Dis Ther Original Research INTRODUCTION: Septic patients requiring intensive care unit (ICU) readmission are at high risk of mortality, but research focusing on the association of ICU readmission due to sepsis and mortality is limited. The aim of this study was to develop and validate a machine learning (ML) model for predicting in-hospital mortality in septic patients readmitted to the ICU using routinely available clinical data. METHODS: The data used in this study were obtained from the Medical Information Mart for Intensive Care (MIMIC-IV, v1.0) database, between 2008 and 2019. The study cohort included patients with sepsis requiring ICU readmission. The data were randomly split into a training (75%) data set and a validation (25%) data set. Nine popular ML models were developed to predict mortality in septic patients readmitted to the ICU. The model with the best accuracy and area under the curve (A.C.) in the validation cohort was defined as the optimal model and was selected for further prediction studies. The SHAPELY Additive explanations (SHAP) values and Local Interpretable Model-Agnostic Explanation (LIME) methods were used to improve the interpretability of the optimal model. RESULTS: A total of 1117 septic patients who had required ICU readmission during the study period were enrolled in the study. Of these participants, 434 (38.9%) were female, and the median (interquartile range [IQR]) age was 68.6 (58.4–79.2) years. The median (IQR) ICU interval duration was 2.60 (0.64–5.78) days. After feature selection, 31 of 47 clinical factors were ultimately chosen for use in model construction. Of the nine ML models tested, the best performance was achieved with the random forest (RF) model, with an A.C. of 0.81, an accuracy of 85% and a precision of 62% in the validation cohort. The SHAP summary analysis revealed that Glasgow Coma Scale score, urine output, blood urea nitrogen, lactate, platelet count and systolic blood pressure were the top six most important factors contributing to the RF model. Additionally, the LIME method demonstrated how the RF model works in terms of explaining risk of death prediction in septic patients requiring ICU readmission. CONCLUSION: The ML models reported here showed a good prognostic prediction ability in septic patients requiring ICU readmission. Of the features selected, the parameters related to organ perfusion made the largest contribution to outcome prediction during ICU readmission in septic patients. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s40121-022-00671-3. Springer Healthcare 2022-07-14 2022-08 /pmc/articles/PMC9282631/ /pubmed/35835943 http://dx.doi.org/10.1007/s40121-022-00671-3 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by-nc/4.0/Open AccessThis article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) .
spellingShingle Original Research
Hu, Chang
Li, Lu
Li, Yiming
Wang, Fengyun
Hu, Bo
Peng, Zhiyong
Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
title Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
title_full Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
title_fullStr Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
title_full_unstemmed Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
title_short Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
title_sort explainable machine-learning model for prediction of in-hospital mortality in septic patients requiring intensive care unit readmission
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9282631/
https://www.ncbi.nlm.nih.gov/pubmed/35835943
http://dx.doi.org/10.1007/s40121-022-00671-3
work_keys_str_mv AT huchang explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission
AT lilu explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission
AT liyiming explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission
AT wangfengyun explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission
AT hubo explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission
AT pengzhiyong explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission