Cargando…

Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records

IMPORTANCE: Acute kidney injury (AKI) is a heterogeneous syndrome prevalent among hospitalized patients. Personalized risk estimation and risk factor identification may allow effective intervention and improved outcomes. OBJECTIVE: To develop and validate personalized AKI risk estimation models usin...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Kang, Zhang, Xiangzhou, Chen, Weiqi, Yu, Alan S. L., Kellum, John A., Matheny, Michael E., Simpson, Steven Q., Hu, Yong, Liu, Mei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Medical Association 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9250052/
https://www.ncbi.nlm.nih.gov/pubmed/35796212
http://dx.doi.org/10.1001/jamanetworkopen.2022.19776
_version_ 1784739725106479104
author Liu, Kang
Zhang, Xiangzhou
Chen, Weiqi
Yu, Alan S. L.
Kellum, John A.
Matheny, Michael E.
Simpson, Steven Q.
Hu, Yong
Liu, Mei
author_facet Liu, Kang
Zhang, Xiangzhou
Chen, Weiqi
Yu, Alan S. L.
Kellum, John A.
Matheny, Michael E.
Simpson, Steven Q.
Hu, Yong
Liu, Mei
author_sort Liu, Kang
collection PubMed
description IMPORTANCE: Acute kidney injury (AKI) is a heterogeneous syndrome prevalent among hospitalized patients. Personalized risk estimation and risk factor identification may allow effective intervention and improved outcomes. OBJECTIVE: To develop and validate personalized AKI risk estimation models using electronic health records (EHRs), examine whether personalized models were beneficial in comparison with global and subgroup models, and assess the heterogeneity of risk factors and their outcomes in different subpopulations. DESIGN, SETTING, AND PARTICIPANTS: This diagnostic study analyzed EHR data from 1 tertiary care hospital and used machine learning and logistic regression to develop and validate global, subgroup, and personalized risk estimation models. Transfer learning was implemented to enhance the personalized model. Predictor outcomes across subpopulations were analyzed, and metaregression was used to explore predictor interactions. Adults who were hospitalized for 2 or more days from November 1, 2007, to December 31, 2016, were included in the analysis. Patients with moderate or severe kidney dysfunction at admission were excluded. Data were analyzed between August 28, 2019, and May 8, 2022. EXPOSURES: Clinical and laboratory variables in the EHR. MAIN OUTCOMES AND MEASURES: The main outcome was AKI of any severity, and AKI was defined using the Kidney Disease: Improving Global Outcomes serum creatinine criteria. Performance of the models was measured with area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve, and calibration. RESULTS: The study cohort comprised 76 957 inpatient encounters. Patients had a mean (SD) age of 55.5 (17.4) years and included 42 159 men (54.8%). The personalized model with transfer learning outperformed the global model for AKI estimation in terms of AUROC among general inpatients (0.78 [95% CI, 0.77-0.79] vs 0.76 [95% CI, 0.75-0.76]; P < .001) and across the high-risk subgroups (0.79 [95% CI, 0.78-0.80] vs 0.75 [95% CI, 0.74-0.77]; P < .001) and low-risk subgroups (0.74 [95% CI, 0.73-0.75] vs 0.71 [95% CI, 0.70-0.72]; P < .001). The AUROC improvement reached 0.13 for the high-risk subgroups, such as those undergoing liver transplant and cardiac surgery. Moreover, the personalized model with transfer learning performed better than or comparably with the best published models in well-studied AKI subgroups. Predictor outcomes varied significantly between patients, and interaction analysis uncovered modifiers of the predictor outcomes. CONCLUSIONS AND RELEVANCE: Results of this study demonstrated that a personalized modeling with transfer learning is an improved AKI risk estimation approach that can be used across diverse patient subgroups. Risk factor heterogeneity and interactions at the individual level highlighted the need for agile, personalized care.
format Online
Article
Text
id pubmed-9250052
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher American Medical Association
record_format MEDLINE/PubMed
spelling pubmed-92500522022-07-18 Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records Liu, Kang Zhang, Xiangzhou Chen, Weiqi Yu, Alan S. L. Kellum, John A. Matheny, Michael E. Simpson, Steven Q. Hu, Yong Liu, Mei JAMA Netw Open Original Investigation IMPORTANCE: Acute kidney injury (AKI) is a heterogeneous syndrome prevalent among hospitalized patients. Personalized risk estimation and risk factor identification may allow effective intervention and improved outcomes. OBJECTIVE: To develop and validate personalized AKI risk estimation models using electronic health records (EHRs), examine whether personalized models were beneficial in comparison with global and subgroup models, and assess the heterogeneity of risk factors and their outcomes in different subpopulations. DESIGN, SETTING, AND PARTICIPANTS: This diagnostic study analyzed EHR data from 1 tertiary care hospital and used machine learning and logistic regression to develop and validate global, subgroup, and personalized risk estimation models. Transfer learning was implemented to enhance the personalized model. Predictor outcomes across subpopulations were analyzed, and metaregression was used to explore predictor interactions. Adults who were hospitalized for 2 or more days from November 1, 2007, to December 31, 2016, were included in the analysis. Patients with moderate or severe kidney dysfunction at admission were excluded. Data were analyzed between August 28, 2019, and May 8, 2022. EXPOSURES: Clinical and laboratory variables in the EHR. MAIN OUTCOMES AND MEASURES: The main outcome was AKI of any severity, and AKI was defined using the Kidney Disease: Improving Global Outcomes serum creatinine criteria. Performance of the models was measured with area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve, and calibration. RESULTS: The study cohort comprised 76 957 inpatient encounters. Patients had a mean (SD) age of 55.5 (17.4) years and included 42 159 men (54.8%). The personalized model with transfer learning outperformed the global model for AKI estimation in terms of AUROC among general inpatients (0.78 [95% CI, 0.77-0.79] vs 0.76 [95% CI, 0.75-0.76]; P < .001) and across the high-risk subgroups (0.79 [95% CI, 0.78-0.80] vs 0.75 [95% CI, 0.74-0.77]; P < .001) and low-risk subgroups (0.74 [95% CI, 0.73-0.75] vs 0.71 [95% CI, 0.70-0.72]; P < .001). The AUROC improvement reached 0.13 for the high-risk subgroups, such as those undergoing liver transplant and cardiac surgery. Moreover, the personalized model with transfer learning performed better than or comparably with the best published models in well-studied AKI subgroups. Predictor outcomes varied significantly between patients, and interaction analysis uncovered modifiers of the predictor outcomes. CONCLUSIONS AND RELEVANCE: Results of this study demonstrated that a personalized modeling with transfer learning is an improved AKI risk estimation approach that can be used across diverse patient subgroups. Risk factor heterogeneity and interactions at the individual level highlighted the need for agile, personalized care. American Medical Association 2022-07-01 /pmc/articles/PMC9250052/ /pubmed/35796212 http://dx.doi.org/10.1001/jamanetworkopen.2022.19776 Text en Copyright 2022 Liu K et al. JAMA Network Open. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the CC-BY License.
spellingShingle Original Investigation
Liu, Kang
Zhang, Xiangzhou
Chen, Weiqi
Yu, Alan S. L.
Kellum, John A.
Matheny, Michael E.
Simpson, Steven Q.
Hu, Yong
Liu, Mei
Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records
title Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records
title_full Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records
title_fullStr Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records
title_full_unstemmed Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records
title_short Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records
title_sort development and validation of a personalized model with transfer learning for acute kidney injury risk estimation using electronic health records
topic Original Investigation
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9250052/
https://www.ncbi.nlm.nih.gov/pubmed/35796212
http://dx.doi.org/10.1001/jamanetworkopen.2022.19776
work_keys_str_mv AT liukang developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT zhangxiangzhou developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT chenweiqi developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT yualansl developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT kellumjohna developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT mathenymichaele developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT simpsonstevenq developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT huyong developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords
AT liumei developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords