Cargando…
Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission
INTRODUCTION: Septic patients requiring intensive care unit (ICU) readmission are at high risk of mortality, but research focusing on the association of ICU readmission due to sepsis and mortality is limited. The aim of this study was to develop and validate a machine learning (ML) model for predict...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Healthcare
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9282631/ https://www.ncbi.nlm.nih.gov/pubmed/35835943 http://dx.doi.org/10.1007/s40121-022-00671-3 |
_version_ | 1784747146441916416 |
---|---|
author | Hu, Chang Li, Lu Li, Yiming Wang, Fengyun Hu, Bo Peng, Zhiyong |
author_facet | Hu, Chang Li, Lu Li, Yiming Wang, Fengyun Hu, Bo Peng, Zhiyong |
author_sort | Hu, Chang |
collection | PubMed |
description | INTRODUCTION: Septic patients requiring intensive care unit (ICU) readmission are at high risk of mortality, but research focusing on the association of ICU readmission due to sepsis and mortality is limited. The aim of this study was to develop and validate a machine learning (ML) model for predicting in-hospital mortality in septic patients readmitted to the ICU using routinely available clinical data. METHODS: The data used in this study were obtained from the Medical Information Mart for Intensive Care (MIMIC-IV, v1.0) database, between 2008 and 2019. The study cohort included patients with sepsis requiring ICU readmission. The data were randomly split into a training (75%) data set and a validation (25%) data set. Nine popular ML models were developed to predict mortality in septic patients readmitted to the ICU. The model with the best accuracy and area under the curve (A.C.) in the validation cohort was defined as the optimal model and was selected for further prediction studies. The SHAPELY Additive explanations (SHAP) values and Local Interpretable Model-Agnostic Explanation (LIME) methods were used to improve the interpretability of the optimal model. RESULTS: A total of 1117 septic patients who had required ICU readmission during the study period were enrolled in the study. Of these participants, 434 (38.9%) were female, and the median (interquartile range [IQR]) age was 68.6 (58.4–79.2) years. The median (IQR) ICU interval duration was 2.60 (0.64–5.78) days. After feature selection, 31 of 47 clinical factors were ultimately chosen for use in model construction. Of the nine ML models tested, the best performance was achieved with the random forest (RF) model, with an A.C. of 0.81, an accuracy of 85% and a precision of 62% in the validation cohort. The SHAP summary analysis revealed that Glasgow Coma Scale score, urine output, blood urea nitrogen, lactate, platelet count and systolic blood pressure were the top six most important factors contributing to the RF model. Additionally, the LIME method demonstrated how the RF model works in terms of explaining risk of death prediction in septic patients requiring ICU readmission. CONCLUSION: The ML models reported here showed a good prognostic prediction ability in septic patients requiring ICU readmission. Of the features selected, the parameters related to organ perfusion made the largest contribution to outcome prediction during ICU readmission in septic patients. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s40121-022-00671-3. |
format | Online Article Text |
id | pubmed-9282631 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Springer Healthcare |
record_format | MEDLINE/PubMed |
spelling | pubmed-92826312022-07-15 Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission Hu, Chang Li, Lu Li, Yiming Wang, Fengyun Hu, Bo Peng, Zhiyong Infect Dis Ther Original Research INTRODUCTION: Septic patients requiring intensive care unit (ICU) readmission are at high risk of mortality, but research focusing on the association of ICU readmission due to sepsis and mortality is limited. The aim of this study was to develop and validate a machine learning (ML) model for predicting in-hospital mortality in septic patients readmitted to the ICU using routinely available clinical data. METHODS: The data used in this study were obtained from the Medical Information Mart for Intensive Care (MIMIC-IV, v1.0) database, between 2008 and 2019. The study cohort included patients with sepsis requiring ICU readmission. The data were randomly split into a training (75%) data set and a validation (25%) data set. Nine popular ML models were developed to predict mortality in septic patients readmitted to the ICU. The model with the best accuracy and area under the curve (A.C.) in the validation cohort was defined as the optimal model and was selected for further prediction studies. The SHAPELY Additive explanations (SHAP) values and Local Interpretable Model-Agnostic Explanation (LIME) methods were used to improve the interpretability of the optimal model. RESULTS: A total of 1117 septic patients who had required ICU readmission during the study period were enrolled in the study. Of these participants, 434 (38.9%) were female, and the median (interquartile range [IQR]) age was 68.6 (58.4–79.2) years. The median (IQR) ICU interval duration was 2.60 (0.64–5.78) days. After feature selection, 31 of 47 clinical factors were ultimately chosen for use in model construction. Of the nine ML models tested, the best performance was achieved with the random forest (RF) model, with an A.C. of 0.81, an accuracy of 85% and a precision of 62% in the validation cohort. The SHAP summary analysis revealed that Glasgow Coma Scale score, urine output, blood urea nitrogen, lactate, platelet count and systolic blood pressure were the top six most important factors contributing to the RF model. Additionally, the LIME method demonstrated how the RF model works in terms of explaining risk of death prediction in septic patients requiring ICU readmission. CONCLUSION: The ML models reported here showed a good prognostic prediction ability in septic patients requiring ICU readmission. Of the features selected, the parameters related to organ perfusion made the largest contribution to outcome prediction during ICU readmission in septic patients. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s40121-022-00671-3. Springer Healthcare 2022-07-14 2022-08 /pmc/articles/PMC9282631/ /pubmed/35835943 http://dx.doi.org/10.1007/s40121-022-00671-3 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by-nc/4.0/Open AccessThis article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) . |
spellingShingle | Original Research Hu, Chang Li, Lu Li, Yiming Wang, Fengyun Hu, Bo Peng, Zhiyong Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission |
title | Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission |
title_full | Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission |
title_fullStr | Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission |
title_full_unstemmed | Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission |
title_short | Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission |
title_sort | explainable machine-learning model for prediction of in-hospital mortality in septic patients requiring intensive care unit readmission |
topic | Original Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9282631/ https://www.ncbi.nlm.nih.gov/pubmed/35835943 http://dx.doi.org/10.1007/s40121-022-00671-3 |
work_keys_str_mv | AT huchang explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission AT lilu explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission AT liyiming explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission AT wangfengyun explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission AT hubo explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission AT pengzhiyong explainablemachinelearningmodelforpredictionofinhospitalmortalityinsepticpatientsrequiringintensivecareunitreadmission |