Cargando…
Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records
IMPORTANCE: Acute kidney injury (AKI) is a heterogeneous syndrome prevalent among hospitalized patients. Personalized risk estimation and risk factor identification may allow effective intervention and improved outcomes. OBJECTIVE: To develop and validate personalized AKI risk estimation models usin...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
American Medical Association
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9250052/ https://www.ncbi.nlm.nih.gov/pubmed/35796212 http://dx.doi.org/10.1001/jamanetworkopen.2022.19776 |
_version_ | 1784739725106479104 |
---|---|
author | Liu, Kang Zhang, Xiangzhou Chen, Weiqi Yu, Alan S. L. Kellum, John A. Matheny, Michael E. Simpson, Steven Q. Hu, Yong Liu, Mei |
author_facet | Liu, Kang Zhang, Xiangzhou Chen, Weiqi Yu, Alan S. L. Kellum, John A. Matheny, Michael E. Simpson, Steven Q. Hu, Yong Liu, Mei |
author_sort | Liu, Kang |
collection | PubMed |
description | IMPORTANCE: Acute kidney injury (AKI) is a heterogeneous syndrome prevalent among hospitalized patients. Personalized risk estimation and risk factor identification may allow effective intervention and improved outcomes. OBJECTIVE: To develop and validate personalized AKI risk estimation models using electronic health records (EHRs), examine whether personalized models were beneficial in comparison with global and subgroup models, and assess the heterogeneity of risk factors and their outcomes in different subpopulations. DESIGN, SETTING, AND PARTICIPANTS: This diagnostic study analyzed EHR data from 1 tertiary care hospital and used machine learning and logistic regression to develop and validate global, subgroup, and personalized risk estimation models. Transfer learning was implemented to enhance the personalized model. Predictor outcomes across subpopulations were analyzed, and metaregression was used to explore predictor interactions. Adults who were hospitalized for 2 or more days from November 1, 2007, to December 31, 2016, were included in the analysis. Patients with moderate or severe kidney dysfunction at admission were excluded. Data were analyzed between August 28, 2019, and May 8, 2022. EXPOSURES: Clinical and laboratory variables in the EHR. MAIN OUTCOMES AND MEASURES: The main outcome was AKI of any severity, and AKI was defined using the Kidney Disease: Improving Global Outcomes serum creatinine criteria. Performance of the models was measured with area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve, and calibration. RESULTS: The study cohort comprised 76 957 inpatient encounters. Patients had a mean (SD) age of 55.5 (17.4) years and included 42 159 men (54.8%). The personalized model with transfer learning outperformed the global model for AKI estimation in terms of AUROC among general inpatients (0.78 [95% CI, 0.77-0.79] vs 0.76 [95% CI, 0.75-0.76]; P < .001) and across the high-risk subgroups (0.79 [95% CI, 0.78-0.80] vs 0.75 [95% CI, 0.74-0.77]; P < .001) and low-risk subgroups (0.74 [95% CI, 0.73-0.75] vs 0.71 [95% CI, 0.70-0.72]; P < .001). The AUROC improvement reached 0.13 for the high-risk subgroups, such as those undergoing liver transplant and cardiac surgery. Moreover, the personalized model with transfer learning performed better than or comparably with the best published models in well-studied AKI subgroups. Predictor outcomes varied significantly between patients, and interaction analysis uncovered modifiers of the predictor outcomes. CONCLUSIONS AND RELEVANCE: Results of this study demonstrated that a personalized modeling with transfer learning is an improved AKI risk estimation approach that can be used across diverse patient subgroups. Risk factor heterogeneity and interactions at the individual level highlighted the need for agile, personalized care. |
format | Online Article Text |
id | pubmed-9250052 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | American Medical Association |
record_format | MEDLINE/PubMed |
spelling | pubmed-92500522022-07-18 Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records Liu, Kang Zhang, Xiangzhou Chen, Weiqi Yu, Alan S. L. Kellum, John A. Matheny, Michael E. Simpson, Steven Q. Hu, Yong Liu, Mei JAMA Netw Open Original Investigation IMPORTANCE: Acute kidney injury (AKI) is a heterogeneous syndrome prevalent among hospitalized patients. Personalized risk estimation and risk factor identification may allow effective intervention and improved outcomes. OBJECTIVE: To develop and validate personalized AKI risk estimation models using electronic health records (EHRs), examine whether personalized models were beneficial in comparison with global and subgroup models, and assess the heterogeneity of risk factors and their outcomes in different subpopulations. DESIGN, SETTING, AND PARTICIPANTS: This diagnostic study analyzed EHR data from 1 tertiary care hospital and used machine learning and logistic regression to develop and validate global, subgroup, and personalized risk estimation models. Transfer learning was implemented to enhance the personalized model. Predictor outcomes across subpopulations were analyzed, and metaregression was used to explore predictor interactions. Adults who were hospitalized for 2 or more days from November 1, 2007, to December 31, 2016, were included in the analysis. Patients with moderate or severe kidney dysfunction at admission were excluded. Data were analyzed between August 28, 2019, and May 8, 2022. EXPOSURES: Clinical and laboratory variables in the EHR. MAIN OUTCOMES AND MEASURES: The main outcome was AKI of any severity, and AKI was defined using the Kidney Disease: Improving Global Outcomes serum creatinine criteria. Performance of the models was measured with area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve, and calibration. RESULTS: The study cohort comprised 76 957 inpatient encounters. Patients had a mean (SD) age of 55.5 (17.4) years and included 42 159 men (54.8%). The personalized model with transfer learning outperformed the global model for AKI estimation in terms of AUROC among general inpatients (0.78 [95% CI, 0.77-0.79] vs 0.76 [95% CI, 0.75-0.76]; P < .001) and across the high-risk subgroups (0.79 [95% CI, 0.78-0.80] vs 0.75 [95% CI, 0.74-0.77]; P < .001) and low-risk subgroups (0.74 [95% CI, 0.73-0.75] vs 0.71 [95% CI, 0.70-0.72]; P < .001). The AUROC improvement reached 0.13 for the high-risk subgroups, such as those undergoing liver transplant and cardiac surgery. Moreover, the personalized model with transfer learning performed better than or comparably with the best published models in well-studied AKI subgroups. Predictor outcomes varied significantly between patients, and interaction analysis uncovered modifiers of the predictor outcomes. CONCLUSIONS AND RELEVANCE: Results of this study demonstrated that a personalized modeling with transfer learning is an improved AKI risk estimation approach that can be used across diverse patient subgroups. Risk factor heterogeneity and interactions at the individual level highlighted the need for agile, personalized care. American Medical Association 2022-07-01 /pmc/articles/PMC9250052/ /pubmed/35796212 http://dx.doi.org/10.1001/jamanetworkopen.2022.19776 Text en Copyright 2022 Liu K et al. JAMA Network Open. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the CC-BY License. |
spellingShingle | Original Investigation Liu, Kang Zhang, Xiangzhou Chen, Weiqi Yu, Alan S. L. Kellum, John A. Matheny, Michael E. Simpson, Steven Q. Hu, Yong Liu, Mei Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records |
title | Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records |
title_full | Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records |
title_fullStr | Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records |
title_full_unstemmed | Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records |
title_short | Development and Validation of a Personalized Model With Transfer Learning for Acute Kidney Injury Risk Estimation Using Electronic Health Records |
title_sort | development and validation of a personalized model with transfer learning for acute kidney injury risk estimation using electronic health records |
topic | Original Investigation |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9250052/ https://www.ncbi.nlm.nih.gov/pubmed/35796212 http://dx.doi.org/10.1001/jamanetworkopen.2022.19776 |
work_keys_str_mv | AT liukang developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT zhangxiangzhou developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT chenweiqi developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT yualansl developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT kellumjohna developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT mathenymichaele developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT simpsonstevenq developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT huyong developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords AT liumei developmentandvalidationofapersonalizedmodelwithtransferlearningforacutekidneyinjuryriskestimationusingelectronichealthrecords |