Cargando…

Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study

BACKGROUND: The increasing number of patients treated with peritoneal dialysis (PD) and their consistently high rate of hospital admissions have placed a large burden on the health care system. Early clinical interventions and optimal management of patients at a high risk of prolonged length of stay...

Descripción completa

Detalles Bibliográficos
Autores principales: Kong, Guilan, Wu, Jingyi, Chu, Hong, Yang, Chao, Lin, Yu, Lin, Ke, Shi, Ying, Wang, Haibo, Zhang, Luxia
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8173398/
https://www.ncbi.nlm.nih.gov/pubmed/34009135
http://dx.doi.org/10.2196/17886
_version_ 1783702716114010112
author Kong, Guilan
Wu, Jingyi
Chu, Hong
Yang, Chao
Lin, Yu
Lin, Ke
Shi, Ying
Wang, Haibo
Zhang, Luxia
author_facet Kong, Guilan
Wu, Jingyi
Chu, Hong
Yang, Chao
Lin, Yu
Lin, Ke
Shi, Ying
Wang, Haibo
Zhang, Luxia
author_sort Kong, Guilan
collection PubMed
description BACKGROUND: The increasing number of patients treated with peritoneal dialysis (PD) and their consistently high rate of hospital admissions have placed a large burden on the health care system. Early clinical interventions and optimal management of patients at a high risk of prolonged length of stay (pLOS) may help improve the medical efficiency and prognosis of PD-treated patients. If timely clinical interventions are not provided, patients at a high risk of pLOS may face a poor prognosis and high medical expenses, which will also be a burden on hospitals. Therefore, physicians need an effective pLOS prediction model for PD-treated patients. OBJECTIVE: This study aimed to develop an optimal data-driven model for predicting the pLOS risk of PD-treated patients using basic admission data. METHODS: Patient data collected using the Hospital Quality Monitoring System (HQMS) in China were used to develop pLOS prediction models. A stacking model was constructed with support vector machine, random forest (RF), and K-nearest neighbor algorithms as its base models and traditional logistic regression (LR) as its meta-model. The meta-model used the outputs of all 3 base models as input and generated the output of the stacking model. Another LR-based pLOS prediction model was built as the benchmark model. The prediction performance of the stacking model was compared with that of its base models and the benchmark model. Five-fold cross-validation was employed to develop and validate the models. Performance measures included the Brier score, area under the receiver operating characteristic curve (AUROC), estimated calibration index (ECI), accuracy, sensitivity, specificity, and geometric mean (Gm). In addition, a calibration plot was employed to visually demonstrate the calibration power of each model. RESULTS: The final cohort extracted from the HQMS database consisted of 23,992 eligible PD-treated patients, among whom 30.3% had a pLOS (ie, longer than the average LOS, which was 16 days in our study). Among the models, the stacking model achieved the best calibration (ECI 8.691), balanced accuracy (Gm 0.690), accuracy (0.695), and specificity (0.701). Meanwhile, the stacking and RF models had the best overall performance (Brier score 0.174 for both) and discrimination (AUROC 0.757 for the stacking model and 0.756 for the RF model). Compared with the benchmark LR model, the stacking model was superior in all performance measures except sensitivity, but there was no significant difference in sensitivity between the 2 models. The 2-sided t tests revealed significant performance differences between the stacking and LR models in overall performance, discrimination, calibration, balanced accuracy, and accuracy. CONCLUSIONS: This study is the first to develop data-driven pLOS prediction models for PD-treated patients using basic admission data from a national database. The results indicate the feasibility of utilizing a stacking-based pLOS prediction model for PD-treated patients. The pLOS prediction tools developed in this study have the potential to assist clinicians in identifying patients at a high risk of pLOS and to allocate resources optimally for PD-treated patients.
format Online
Article
Text
id pubmed-8173398
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-81733982021-06-11 Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study Kong, Guilan Wu, Jingyi Chu, Hong Yang, Chao Lin, Yu Lin, Ke Shi, Ying Wang, Haibo Zhang, Luxia JMIR Med Inform Original Paper BACKGROUND: The increasing number of patients treated with peritoneal dialysis (PD) and their consistently high rate of hospital admissions have placed a large burden on the health care system. Early clinical interventions and optimal management of patients at a high risk of prolonged length of stay (pLOS) may help improve the medical efficiency and prognosis of PD-treated patients. If timely clinical interventions are not provided, patients at a high risk of pLOS may face a poor prognosis and high medical expenses, which will also be a burden on hospitals. Therefore, physicians need an effective pLOS prediction model for PD-treated patients. OBJECTIVE: This study aimed to develop an optimal data-driven model for predicting the pLOS risk of PD-treated patients using basic admission data. METHODS: Patient data collected using the Hospital Quality Monitoring System (HQMS) in China were used to develop pLOS prediction models. A stacking model was constructed with support vector machine, random forest (RF), and K-nearest neighbor algorithms as its base models and traditional logistic regression (LR) as its meta-model. The meta-model used the outputs of all 3 base models as input and generated the output of the stacking model. Another LR-based pLOS prediction model was built as the benchmark model. The prediction performance of the stacking model was compared with that of its base models and the benchmark model. Five-fold cross-validation was employed to develop and validate the models. Performance measures included the Brier score, area under the receiver operating characteristic curve (AUROC), estimated calibration index (ECI), accuracy, sensitivity, specificity, and geometric mean (Gm). In addition, a calibration plot was employed to visually demonstrate the calibration power of each model. RESULTS: The final cohort extracted from the HQMS database consisted of 23,992 eligible PD-treated patients, among whom 30.3% had a pLOS (ie, longer than the average LOS, which was 16 days in our study). Among the models, the stacking model achieved the best calibration (ECI 8.691), balanced accuracy (Gm 0.690), accuracy (0.695), and specificity (0.701). Meanwhile, the stacking and RF models had the best overall performance (Brier score 0.174 for both) and discrimination (AUROC 0.757 for the stacking model and 0.756 for the RF model). Compared with the benchmark LR model, the stacking model was superior in all performance measures except sensitivity, but there was no significant difference in sensitivity between the 2 models. The 2-sided t tests revealed significant performance differences between the stacking and LR models in overall performance, discrimination, calibration, balanced accuracy, and accuracy. CONCLUSIONS: This study is the first to develop data-driven pLOS prediction models for PD-treated patients using basic admission data from a national database. The results indicate the feasibility of utilizing a stacking-based pLOS prediction model for PD-treated patients. The pLOS prediction tools developed in this study have the potential to assist clinicians in identifying patients at a high risk of pLOS and to allocate resources optimally for PD-treated patients. JMIR Publications 2021-05-19 /pmc/articles/PMC8173398/ /pubmed/34009135 http://dx.doi.org/10.2196/17886 Text en ©Guilan Kong, Jingyi Wu, Hong Chu, Chao Yang, Yu Lin, Ke Lin, Ying Shi, Haibo Wang, Luxia Zhang. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 19.05.2021. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Kong, Guilan
Wu, Jingyi
Chu, Hong
Yang, Chao
Lin, Yu
Lin, Ke
Shi, Ying
Wang, Haibo
Zhang, Luxia
Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study
title Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study
title_full Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study
title_fullStr Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study
title_full_unstemmed Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study
title_short Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study
title_sort predicting prolonged length of hospital stay for peritoneal dialysis–treated patients using stacked generalization: model development and validation study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8173398/
https://www.ncbi.nlm.nih.gov/pubmed/34009135
http://dx.doi.org/10.2196/17886
work_keys_str_mv AT kongguilan predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT wujingyi predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT chuhong predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT yangchao predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT linyu predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT linke predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT shiying predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT wanghaibo predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy
AT zhangluxia predictingprolongedlengthofhospitalstayforperitonealdialysistreatedpatientsusingstackedgeneralizationmodeldevelopmentandvalidationstudy