Cargando…

Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery

OBJECTIVE: Postoperative acute kidney injury (PO-AKI) is a common complication after cardiac surgery. We aimed to evaluate whether machine learning algorithms could significantly improve the risk prediction of PO-AKI. METHODS: The retrospective cohort study included 2310 adult patients undergoing ca...

Descripción completa

Detalles Bibliográficos
Autores principales: Jiang, Jicheng, Liu, Xinyun, Cheng, Zhaoyun, Liu, Qianjin, Xing, Wenlu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10631004/
https://www.ncbi.nlm.nih.gov/pubmed/37936067
http://dx.doi.org/10.1186/s12882-023-03324-w
_version_ 1785132275204096000
author Jiang, Jicheng
Liu, Xinyun
Cheng, Zhaoyun
Liu, Qianjin
Xing, Wenlu
author_facet Jiang, Jicheng
Liu, Xinyun
Cheng, Zhaoyun
Liu, Qianjin
Xing, Wenlu
author_sort Jiang, Jicheng
collection PubMed
description OBJECTIVE: Postoperative acute kidney injury (PO-AKI) is a common complication after cardiac surgery. We aimed to evaluate whether machine learning algorithms could significantly improve the risk prediction of PO-AKI. METHODS: The retrospective cohort study included 2310 adult patients undergoing cardiac surgery in a tertiary teaching hospital, China. Postoperative AKI and severe AKI were identified by the modified KDIGO definition. The sample was randomly divided into a derivation set and a validation set based on a ratio of 4:1. Exploiting conventional logistic regression (LR) and five ML algorithms including decision tree, random forest, gradient boosting classifier (GBC), Gaussian Naive Bayes and multilayer perceptron, we developed and validated the prediction models of PO-AKI. We implemented the interpretation of models using SHapley Additive exPlanation (SHAP) analysis. RESULTS: Postoperative AKI and severe AKI occurred in 1020 (44.2%) and 286 (12.4%) patients, respectively. Compared with the five ML models, LR model for PO-AKI exhibited the largest AUC (0.812, 95%CI: 0.756, 0.860, all P < 0.05), sensitivity (0.774, 95%CI: 0.719, 0.813), accuracy (0.753, 95%CI: 0.719, 0.781) and Youden index (0.513, 95%CI: 0.451, 0.573). Regarding severe AKI, GBC algorithm showed a significantly higher AUC than the other four ML models (all P < 0.05). Although no significant difference (P = 0.173) was observed in AUCs between GBC (0.86, 95%CI: 0.808, 0.902) and conventional logistic regression (0.803, 95%CI: 0.746, 0.852), GBC achieved greater sensitivity, accuracy and Youden index than conventional LR. Notably, SHAP analyses showed that preoperative serum creatinine, hyperlipidemia, lipid-lowering agents and assisted ventilation time were consistently among the top five important predictors for both postoperative AKI and severe AKI. CONCLUSION: Logistic regression and GBC algorithm demonstrated moderate to good discrimination and superior performance in predicting PO-AKI and severe AKI, respectively. Interpretation of the models identified the key contributors to the predictions, which could potentially inform clinical interventions. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12882-023-03324-w.
format Online
Article
Text
id pubmed-10631004
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-106310042023-11-07 Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery Jiang, Jicheng Liu, Xinyun Cheng, Zhaoyun Liu, Qianjin Xing, Wenlu BMC Nephrol Research OBJECTIVE: Postoperative acute kidney injury (PO-AKI) is a common complication after cardiac surgery. We aimed to evaluate whether machine learning algorithms could significantly improve the risk prediction of PO-AKI. METHODS: The retrospective cohort study included 2310 adult patients undergoing cardiac surgery in a tertiary teaching hospital, China. Postoperative AKI and severe AKI were identified by the modified KDIGO definition. The sample was randomly divided into a derivation set and a validation set based on a ratio of 4:1. Exploiting conventional logistic regression (LR) and five ML algorithms including decision tree, random forest, gradient boosting classifier (GBC), Gaussian Naive Bayes and multilayer perceptron, we developed and validated the prediction models of PO-AKI. We implemented the interpretation of models using SHapley Additive exPlanation (SHAP) analysis. RESULTS: Postoperative AKI and severe AKI occurred in 1020 (44.2%) and 286 (12.4%) patients, respectively. Compared with the five ML models, LR model for PO-AKI exhibited the largest AUC (0.812, 95%CI: 0.756, 0.860, all P < 0.05), sensitivity (0.774, 95%CI: 0.719, 0.813), accuracy (0.753, 95%CI: 0.719, 0.781) and Youden index (0.513, 95%CI: 0.451, 0.573). Regarding severe AKI, GBC algorithm showed a significantly higher AUC than the other four ML models (all P < 0.05). Although no significant difference (P = 0.173) was observed in AUCs between GBC (0.86, 95%CI: 0.808, 0.902) and conventional logistic regression (0.803, 95%CI: 0.746, 0.852), GBC achieved greater sensitivity, accuracy and Youden index than conventional LR. Notably, SHAP analyses showed that preoperative serum creatinine, hyperlipidemia, lipid-lowering agents and assisted ventilation time were consistently among the top five important predictors for both postoperative AKI and severe AKI. CONCLUSION: Logistic regression and GBC algorithm demonstrated moderate to good discrimination and superior performance in predicting PO-AKI and severe AKI, respectively. Interpretation of the models identified the key contributors to the predictions, which could potentially inform clinical interventions. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12882-023-03324-w. BioMed Central 2023-11-07 /pmc/articles/PMC10631004/ /pubmed/37936067 http://dx.doi.org/10.1186/s12882-023-03324-w Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Jiang, Jicheng
Liu, Xinyun
Cheng, Zhaoyun
Liu, Qianjin
Xing, Wenlu
Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery
title Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery
title_full Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery
title_fullStr Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery
title_full_unstemmed Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery
title_short Interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery
title_sort interpretable machine learning models for early prediction of acute kidney injury after cardiac surgery
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10631004/
https://www.ncbi.nlm.nih.gov/pubmed/37936067
http://dx.doi.org/10.1186/s12882-023-03324-w
work_keys_str_mv AT jiangjicheng interpretablemachinelearningmodelsforearlypredictionofacutekidneyinjuryaftercardiacsurgery
AT liuxinyun interpretablemachinelearningmodelsforearlypredictionofacutekidneyinjuryaftercardiacsurgery
AT chengzhaoyun interpretablemachinelearningmodelsforearlypredictionofacutekidneyinjuryaftercardiacsurgery
AT liuqianjin interpretablemachinelearningmodelsforearlypredictionofacutekidneyinjuryaftercardiacsurgery
AT xingwenlu interpretablemachinelearningmodelsforearlypredictionofacutekidneyinjuryaftercardiacsurgery