Cargando…
Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach
Risk prediction requires comprehensive integration of clinical information and concurrent radiological findings. We present an upgraded chest radiograph (CXR) explainable artificial intelligence (xAI) model, which was trained on 241,723 well-annotated CXRs obtained prior to the onset of the COVID-19...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9729627/ https://www.ncbi.nlm.nih.gov/pubmed/36476724 http://dx.doi.org/10.1038/s41598-022-24721-5 |
_version_ | 1784845511773126656 |
---|---|
author | Chung, Joowon Kim, Doyun Choi, Jongmun Yune, Sehyo Song, Kyoung Doo Kim, Seonkyoung Chua, Michelle Succi, Marc D. Conklin, John Longo, Maria G. Figueiro Ackman, Jeanne B. Petranovic, Milena Lev, Michael H. Do, Synho |
author_facet | Chung, Joowon Kim, Doyun Choi, Jongmun Yune, Sehyo Song, Kyoung Doo Kim, Seonkyoung Chua, Michelle Succi, Marc D. Conklin, John Longo, Maria G. Figueiro Ackman, Jeanne B. Petranovic, Milena Lev, Michael H. Do, Synho |
author_sort | Chung, Joowon |
collection | PubMed |
description | Risk prediction requires comprehensive integration of clinical information and concurrent radiological findings. We present an upgraded chest radiograph (CXR) explainable artificial intelligence (xAI) model, which was trained on 241,723 well-annotated CXRs obtained prior to the onset of the COVID-19 pandemic. Mean area under the receiver operating characteristic curve (AUROC) for detection of 20 radiographic features was 0.955 (95% CI 0.938–0.955) on PA view and 0.909 (95% CI 0.890–0.925) on AP view. Coexistent and correlated radiographic findings are displayed in an interpretation table, and calibrated classifier confidence is displayed on an AI scoreboard. Retrieval of similar feature patches and comparable CXRs from a Model-Derived Atlas provides justification for model predictions. To demonstrate the feasibility of a fine-tuning approach for efficient and scalable development of xAI risk prediction models, we applied our CXR xAI model, in combination with clinical information, to predict oxygen requirement in COVID-19 patients. Prediction accuracy for high flow oxygen (HFO) and mechanical ventilation (MV) was 0.953 and 0.934 at 24 h and 0.932 and 0.836 at 72 h from the time of emergency department (ED) admission, respectively. Our CXR xAI model is auditable and captures key pathophysiological manifestations of cardiorespiratory diseases and cardiothoracic comorbidities. This model can be efficiently and broadly applied via a fine-tuning approach to provide fully automated risk and outcome predictions in various clinical scenarios in real-world practice. |
format | Online Article Text |
id | pubmed-9729627 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-97296272022-12-09 Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach Chung, Joowon Kim, Doyun Choi, Jongmun Yune, Sehyo Song, Kyoung Doo Kim, Seonkyoung Chua, Michelle Succi, Marc D. Conklin, John Longo, Maria G. Figueiro Ackman, Jeanne B. Petranovic, Milena Lev, Michael H. Do, Synho Sci Rep Article Risk prediction requires comprehensive integration of clinical information and concurrent radiological findings. We present an upgraded chest radiograph (CXR) explainable artificial intelligence (xAI) model, which was trained on 241,723 well-annotated CXRs obtained prior to the onset of the COVID-19 pandemic. Mean area under the receiver operating characteristic curve (AUROC) for detection of 20 radiographic features was 0.955 (95% CI 0.938–0.955) on PA view and 0.909 (95% CI 0.890–0.925) on AP view. Coexistent and correlated radiographic findings are displayed in an interpretation table, and calibrated classifier confidence is displayed on an AI scoreboard. Retrieval of similar feature patches and comparable CXRs from a Model-Derived Atlas provides justification for model predictions. To demonstrate the feasibility of a fine-tuning approach for efficient and scalable development of xAI risk prediction models, we applied our CXR xAI model, in combination with clinical information, to predict oxygen requirement in COVID-19 patients. Prediction accuracy for high flow oxygen (HFO) and mechanical ventilation (MV) was 0.953 and 0.934 at 24 h and 0.932 and 0.836 at 72 h from the time of emergency department (ED) admission, respectively. Our CXR xAI model is auditable and captures key pathophysiological manifestations of cardiorespiratory diseases and cardiothoracic comorbidities. This model can be efficiently and broadly applied via a fine-tuning approach to provide fully automated risk and outcome predictions in various clinical scenarios in real-world practice. Nature Publishing Group UK 2022-12-07 /pmc/articles/PMC9729627/ /pubmed/36476724 http://dx.doi.org/10.1038/s41598-022-24721-5 Text en © The Author(s) 2022, corrected publication 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Chung, Joowon Kim, Doyun Choi, Jongmun Yune, Sehyo Song, Kyoung Doo Kim, Seonkyoung Chua, Michelle Succi, Marc D. Conklin, John Longo, Maria G. Figueiro Ackman, Jeanne B. Petranovic, Milena Lev, Michael H. Do, Synho Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach |
title | Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach |
title_full | Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach |
title_fullStr | Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach |
title_full_unstemmed | Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach |
title_short | Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach |
title_sort | prediction of oxygen requirement in patients with covid-19 using a pre-trained chest radiograph xai model: efficient development of auditable risk prediction models via a fine-tuning approach |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9729627/ https://www.ncbi.nlm.nih.gov/pubmed/36476724 http://dx.doi.org/10.1038/s41598-022-24721-5 |
work_keys_str_mv | AT chungjoowon predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT kimdoyun predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT choijongmun predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT yunesehyo predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT songkyoungdoo predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT kimseonkyoung predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT chuamichelle predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT succimarcd predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT conklinjohn predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT longomariagfigueiro predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT ackmanjeanneb predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT petranovicmilena predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT levmichaelh predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach AT dosynho predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach |