Cargando…

Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches

BACKGROUND: The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care. OBJECTIVE: The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality fo...

Descripción completa

Detalles Bibliográficos
Autores principales: Killian, Michael O, Tian, Shubo, Xing, Aiwen, Hughes, Dana, Gupta, Dipankar, Wang, Xiaoyu, He, Zhe
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10334720/
https://www.ncbi.nlm.nih.gov/pubmed/37338974
http://dx.doi.org/10.2196/45352
_version_ 1785070918437961728
author Killian, Michael O
Tian, Shubo
Xing, Aiwen
Hughes, Dana
Gupta, Dipankar
Wang, Xiaoyu
He, Zhe
author_facet Killian, Michael O
Tian, Shubo
Xing, Aiwen
Hughes, Dana
Gupta, Dipankar
Wang, Xiaoyu
He, Zhe
author_sort Killian, Michael O
collection PubMed
description BACKGROUND: The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care. OBJECTIVE: The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients. METHODS: Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models—extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)—as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction. RESULTS: RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705). CONCLUSIONS: This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.
format Online
Article
Text
id pubmed-10334720
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-103347202023-07-12 Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches Killian, Michael O Tian, Shubo Xing, Aiwen Hughes, Dana Gupta, Dipankar Wang, Xiaoyu He, Zhe JMIR Cardio Original Paper BACKGROUND: The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care. OBJECTIVE: The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients. METHODS: Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models—extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)—as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction. RESULTS: RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705). CONCLUSIONS: This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers. JMIR Publications 2023-06-20 /pmc/articles/PMC10334720/ /pubmed/37338974 http://dx.doi.org/10.2196/45352 Text en ©Michael O Killian, Shubo Tian, Aiwen Xing, Dana Hughes, Dipankar Gupta, Xiaoyu Wang, Zhe He. Originally published in JMIR Cardio (https://cardio.jmir.org), 20.06.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Cardio, is properly cited. The complete bibliographic information, a link to the original publication on https://cardio.jmir.org, as well as this copyright and license information must be included.
spellingShingle Original Paper
Killian, Michael O
Tian, Shubo
Xing, Aiwen
Hughes, Dana
Gupta, Dipankar
Wang, Xiaoyu
He, Zhe
Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
title Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
title_full Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
title_fullStr Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
title_full_unstemmed Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
title_short Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
title_sort prediction of outcomes after heart transplantation in pediatric patients using national registry data: evaluation of machine learning approaches
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10334720/
https://www.ncbi.nlm.nih.gov/pubmed/37338974
http://dx.doi.org/10.2196/45352
work_keys_str_mv AT killianmichaelo predictionofoutcomesafterhearttransplantationinpediatricpatientsusingnationalregistrydataevaluationofmachinelearningapproaches
AT tianshubo predictionofoutcomesafterhearttransplantationinpediatricpatientsusingnationalregistrydataevaluationofmachinelearningapproaches
AT xingaiwen predictionofoutcomesafterhearttransplantationinpediatricpatientsusingnationalregistrydataevaluationofmachinelearningapproaches
AT hughesdana predictionofoutcomesafterhearttransplantationinpediatricpatientsusingnationalregistrydataevaluationofmachinelearningapproaches
AT guptadipankar predictionofoutcomesafterhearttransplantationinpediatricpatientsusingnationalregistrydataevaluationofmachinelearningapproaches
AT wangxiaoyu predictionofoutcomesafterhearttransplantationinpediatricpatientsusingnationalregistrydataevaluationofmachinelearningapproaches
AT hezhe predictionofoutcomesafterhearttransplantationinpediatricpatientsusingnationalregistrydataevaluationofmachinelearningapproaches