Cargando…

Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach

Risk prediction requires comprehensive integration of clinical information and concurrent radiological findings. We present an upgraded chest radiograph (CXR) explainable artificial intelligence (xAI) model, which was trained on 241,723 well-annotated CXRs obtained prior to the onset of the COVID-19...

Descripción completa

Detalles Bibliográficos
Autores principales: Chung, Joowon, Kim, Doyun, Choi, Jongmun, Yune, Sehyo, Song, Kyoung Doo, Kim, Seonkyoung, Chua, Michelle, Succi, Marc D., Conklin, John, Longo, Maria G. Figueiro, Ackman, Jeanne B., Petranovic, Milena, Lev, Michael H., Do, Synho
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9729627/
https://www.ncbi.nlm.nih.gov/pubmed/36476724
http://dx.doi.org/10.1038/s41598-022-24721-5
_version_ 1784845511773126656
author Chung, Joowon
Kim, Doyun
Choi, Jongmun
Yune, Sehyo
Song, Kyoung Doo
Kim, Seonkyoung
Chua, Michelle
Succi, Marc D.
Conklin, John
Longo, Maria G. Figueiro
Ackman, Jeanne B.
Petranovic, Milena
Lev, Michael H.
Do, Synho
author_facet Chung, Joowon
Kim, Doyun
Choi, Jongmun
Yune, Sehyo
Song, Kyoung Doo
Kim, Seonkyoung
Chua, Michelle
Succi, Marc D.
Conklin, John
Longo, Maria G. Figueiro
Ackman, Jeanne B.
Petranovic, Milena
Lev, Michael H.
Do, Synho
author_sort Chung, Joowon
collection PubMed
description Risk prediction requires comprehensive integration of clinical information and concurrent radiological findings. We present an upgraded chest radiograph (CXR) explainable artificial intelligence (xAI) model, which was trained on 241,723 well-annotated CXRs obtained prior to the onset of the COVID-19 pandemic. Mean area under the receiver operating characteristic curve (AUROC) for detection of 20 radiographic features was 0.955 (95% CI 0.938–0.955) on PA view and 0.909 (95% CI 0.890–0.925) on AP view. Coexistent and correlated radiographic findings are displayed in an interpretation table, and calibrated classifier confidence is displayed on an AI scoreboard. Retrieval of similar feature patches and comparable CXRs from a Model-Derived Atlas provides justification for model predictions. To demonstrate the feasibility of a fine-tuning approach for efficient and scalable development of xAI risk prediction models, we applied our CXR xAI model, in combination with clinical information, to predict oxygen requirement in COVID-19 patients. Prediction accuracy for high flow oxygen (HFO) and mechanical ventilation (MV) was 0.953 and 0.934 at 24 h and 0.932 and 0.836 at 72 h from the time of emergency department (ED) admission, respectively. Our CXR xAI model is auditable and captures key pathophysiological manifestations of cardiorespiratory diseases and cardiothoracic comorbidities. This model can be efficiently and broadly applied via a fine-tuning approach to provide fully automated risk and outcome predictions in various clinical scenarios in real-world practice.
format Online
Article
Text
id pubmed-9729627
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-97296272022-12-09 Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach Chung, Joowon Kim, Doyun Choi, Jongmun Yune, Sehyo Song, Kyoung Doo Kim, Seonkyoung Chua, Michelle Succi, Marc D. Conklin, John Longo, Maria G. Figueiro Ackman, Jeanne B. Petranovic, Milena Lev, Michael H. Do, Synho Sci Rep Article Risk prediction requires comprehensive integration of clinical information and concurrent radiological findings. We present an upgraded chest radiograph (CXR) explainable artificial intelligence (xAI) model, which was trained on 241,723 well-annotated CXRs obtained prior to the onset of the COVID-19 pandemic. Mean area under the receiver operating characteristic curve (AUROC) for detection of 20 radiographic features was 0.955 (95% CI 0.938–0.955) on PA view and 0.909 (95% CI 0.890–0.925) on AP view. Coexistent and correlated radiographic findings are displayed in an interpretation table, and calibrated classifier confidence is displayed on an AI scoreboard. Retrieval of similar feature patches and comparable CXRs from a Model-Derived Atlas provides justification for model predictions. To demonstrate the feasibility of a fine-tuning approach for efficient and scalable development of xAI risk prediction models, we applied our CXR xAI model, in combination with clinical information, to predict oxygen requirement in COVID-19 patients. Prediction accuracy for high flow oxygen (HFO) and mechanical ventilation (MV) was 0.953 and 0.934 at 24 h and 0.932 and 0.836 at 72 h from the time of emergency department (ED) admission, respectively. Our CXR xAI model is auditable and captures key pathophysiological manifestations of cardiorespiratory diseases and cardiothoracic comorbidities. This model can be efficiently and broadly applied via a fine-tuning approach to provide fully automated risk and outcome predictions in various clinical scenarios in real-world practice. Nature Publishing Group UK 2022-12-07 /pmc/articles/PMC9729627/ /pubmed/36476724 http://dx.doi.org/10.1038/s41598-022-24721-5 Text en © The Author(s) 2022, corrected publication 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Chung, Joowon
Kim, Doyun
Choi, Jongmun
Yune, Sehyo
Song, Kyoung Doo
Kim, Seonkyoung
Chua, Michelle
Succi, Marc D.
Conklin, John
Longo, Maria G. Figueiro
Ackman, Jeanne B.
Petranovic, Milena
Lev, Michael H.
Do, Synho
Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach
title Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach
title_full Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach
title_fullStr Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach
title_full_unstemmed Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach
title_short Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach
title_sort prediction of oxygen requirement in patients with covid-19 using a pre-trained chest radiograph xai model: efficient development of auditable risk prediction models via a fine-tuning approach
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9729627/
https://www.ncbi.nlm.nih.gov/pubmed/36476724
http://dx.doi.org/10.1038/s41598-022-24721-5
work_keys_str_mv AT chungjoowon predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT kimdoyun predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT choijongmun predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT yunesehyo predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT songkyoungdoo predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT kimseonkyoung predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT chuamichelle predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT succimarcd predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT conklinjohn predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT longomariagfigueiro predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT ackmanjeanneb predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT petranovicmilena predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT levmichaelh predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach
AT dosynho predictionofoxygenrequirementinpatientswithcovid19usingapretrainedchestradiographxaimodelefficientdevelopmentofauditableriskpredictionmodelsviaafinetuningapproach