Cargando…

Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction

BACKGROUND: A lack of explainability in published machine learning (ML) models limits clinicians’ understanding of how predictions are made, in turn undermining uptake of the models into clinical practice. OBJECTIVE: The purpose of this study was to develop explainable ML models to predict in-hospit...

Descripción completa

Detalles Bibliográficos
Autores principales: Tarabanis, Constantine, Kalampokis, Evangelos, Khalil, Mahmoud, Alviar, Carlos L., Chinitz, Larry A., Jankelson, Lior
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10435947/
https://www.ncbi.nlm.nih.gov/pubmed/37600443
http://dx.doi.org/10.1016/j.cvdhj.2023.06.001
_version_ 1785092218928758784
author Tarabanis, Constantine
Kalampokis, Evangelos
Khalil, Mahmoud
Alviar, Carlos L.
Chinitz, Larry A.
Jankelson, Lior
author_facet Tarabanis, Constantine
Kalampokis, Evangelos
Khalil, Mahmoud
Alviar, Carlos L.
Chinitz, Larry A.
Jankelson, Lior
author_sort Tarabanis, Constantine
collection PubMed
description BACKGROUND: A lack of explainability in published machine learning (ML) models limits clinicians’ understanding of how predictions are made, in turn undermining uptake of the models into clinical practice. OBJECTIVE: The purpose of this study was to develop explainable ML models to predict in-hospital mortality in patients hospitalized for myocardial infarction (MI). METHODS: Adult patients hospitalized for an MI were identified in the National Inpatient Sample between January 1, 2012, and September 30, 2015. The resulting cohort comprised 457,096 patients described by 64 predictor variables relating to demographic/comorbidity characteristics and in-hospital complications. The gradient boosting algorithm eXtreme Gradient Boosting (XGBoost) was used to develop explainable models for in-hospital mortality prediction in the overall cohort and patient subgroups based on MI type and/or sex. RESULTS: The resulting models exhibited an area under the receiver operating characteristic curve (AUC) ranging from 0.876 to 0.942, specificity 82% to 87%, and sensitivity 75% to 87%. All models exhibited high negative predictive value ≥0.974. The SHapley Additive exPlanation (SHAP) framework was applied to explain the models. The top predictor variables of increasing and decreasing mortality were age and undergoing percutaneous coronary intervention, respectively. Other notable findings included a decreased mortality risk associated with certain patient subpopulations with hyperlipidemia and a comparatively greater risk of death among women below age 55 years. CONCLUSION: The literature lacks explainable ML models predicting in-hospital mortality after an MI. In a national registry, explainable ML models performed best in ruling out in-hospital death post-MI, and their explanation illustrated their potential for guiding hypothesis generation and future study design.
format Online
Article
Text
id pubmed-10435947
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-104359472023-08-19 Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction Tarabanis, Constantine Kalampokis, Evangelos Khalil, Mahmoud Alviar, Carlos L. Chinitz, Larry A. Jankelson, Lior Cardiovasc Digit Health J Original Article BACKGROUND: A lack of explainability in published machine learning (ML) models limits clinicians’ understanding of how predictions are made, in turn undermining uptake of the models into clinical practice. OBJECTIVE: The purpose of this study was to develop explainable ML models to predict in-hospital mortality in patients hospitalized for myocardial infarction (MI). METHODS: Adult patients hospitalized for an MI were identified in the National Inpatient Sample between January 1, 2012, and September 30, 2015. The resulting cohort comprised 457,096 patients described by 64 predictor variables relating to demographic/comorbidity characteristics and in-hospital complications. The gradient boosting algorithm eXtreme Gradient Boosting (XGBoost) was used to develop explainable models for in-hospital mortality prediction in the overall cohort and patient subgroups based on MI type and/or sex. RESULTS: The resulting models exhibited an area under the receiver operating characteristic curve (AUC) ranging from 0.876 to 0.942, specificity 82% to 87%, and sensitivity 75% to 87%. All models exhibited high negative predictive value ≥0.974. The SHapley Additive exPlanation (SHAP) framework was applied to explain the models. The top predictor variables of increasing and decreasing mortality were age and undergoing percutaneous coronary intervention, respectively. Other notable findings included a decreased mortality risk associated with certain patient subpopulations with hyperlipidemia and a comparatively greater risk of death among women below age 55 years. CONCLUSION: The literature lacks explainable ML models predicting in-hospital mortality after an MI. In a national registry, explainable ML models performed best in ruling out in-hospital death post-MI, and their explanation illustrated their potential for guiding hypothesis generation and future study design. Elsevier 2023-06-14 /pmc/articles/PMC10435947/ /pubmed/37600443 http://dx.doi.org/10.1016/j.cvdhj.2023.06.001 Text en © 2023 Heart Rhythm Society. https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Original Article
Tarabanis, Constantine
Kalampokis, Evangelos
Khalil, Mahmoud
Alviar, Carlos L.
Chinitz, Larry A.
Jankelson, Lior
Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction
title Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction
title_full Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction
title_fullStr Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction
title_full_unstemmed Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction
title_short Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction
title_sort explainable shap-xgboost models for in-hospital mortality after myocardial infarction
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10435947/
https://www.ncbi.nlm.nih.gov/pubmed/37600443
http://dx.doi.org/10.1016/j.cvdhj.2023.06.001
work_keys_str_mv AT tarabanisconstantine explainableshapxgboostmodelsforinhospitalmortalityaftermyocardialinfarction
AT kalampokisevangelos explainableshapxgboostmodelsforinhospitalmortalityaftermyocardialinfarction
AT khalilmahmoud explainableshapxgboostmodelsforinhospitalmortalityaftermyocardialinfarction
AT alviarcarlosl explainableshapxgboostmodelsforinhospitalmortalityaftermyocardialinfarction
AT chinitzlarrya explainableshapxgboostmodelsforinhospitalmortalityaftermyocardialinfarction
AT jankelsonlior explainableshapxgboostmodelsforinhospitalmortalityaftermyocardialinfarction