Cargando…
Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department
PURPOSE: To train a deep learning classification algorithm to predict chest radiograph severity scores and clinical outcomes in patients with coronavirus disease 2019 (COVID-19). MATERIALS AND METHODS: In this retrospective cohort study, patients aged 21–50 years who presented to the emergency depar...
Autores principales: | , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Radiological Society of North America
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7754832/ https://www.ncbi.nlm.nih.gov/pubmed/33928257 http://dx.doi.org/10.1148/ryai.2020200098 |
_version_ | 1783626264648613888 |
---|---|
author | Kwon, Young Joon (Fred) Toussie, Danielle Finkelstein, Mark Cedillo, Mario A. Maron, Samuel Z. Manna, Sayan Voutsinas, Nicholas Eber, Corey Jacobi, Adam Bernheim, Adam Gupta, Yogesh Sean Chung, Michael S. Fayad, Zahi A. Glicksberg, Benjamin S. Oermann, Eric K. Costa, Anthony B. |
author_facet | Kwon, Young Joon (Fred) Toussie, Danielle Finkelstein, Mark Cedillo, Mario A. Maron, Samuel Z. Manna, Sayan Voutsinas, Nicholas Eber, Corey Jacobi, Adam Bernheim, Adam Gupta, Yogesh Sean Chung, Michael S. Fayad, Zahi A. Glicksberg, Benjamin S. Oermann, Eric K. Costa, Anthony B. |
author_sort | Kwon, Young Joon (Fred) |
collection | PubMed |
description | PURPOSE: To train a deep learning classification algorithm to predict chest radiograph severity scores and clinical outcomes in patients with coronavirus disease 2019 (COVID-19). MATERIALS AND METHODS: In this retrospective cohort study, patients aged 21–50 years who presented to the emergency department (ED) of a multicenter urban health system from March 10 to 26, 2020, with COVID-19 confirmation at real-time reverse-transcription polymerase chain reaction screening were identified. The initial chest radiographs, clinical variables, and outcomes, including admission, intubation, and survival, were collected within 30 days (n = 338; median age, 39 years; 210 men). Two fellowship-trained cardiothoracic radiologists examined chest radiographs for opacities and assigned a clinically validated severity score. A deep learning algorithm was trained to predict outcomes on a holdout test set composed of patients with confirmed COVID-19 who presented between March 27 and 29, 2020 (n = 161; median age, 60 years; 98 men) for both younger (age range, 21–50 years; n = 51) and older (age >50 years, n = 110) populations. Bootstrapping was used to compute CIs. RESULTS: The model trained on the chest radiograph severity score produced the following areas under the receiver operating characteristic curves (AUCs): 0.80 (95% CI: 0.73, 0.88) for the chest radiograph severity score, 0.76 (95% CI: 0.68, 0.84) for admission, 0.66 (95% CI: 0.56, 0.75) for intubation, and 0.59 (95% CI: 0.49, 0.69) for death. The model trained on clinical variables produced an AUC of 0.64 (95% CI: 0.55, 0.73) for intubation and an AUC of 0.59 (95% CI: 0.50, 0.68) for death. Combining chest radiography and clinical variables increased the AUC of intubation and death to 0.88 (95% CI: 0.79, 0.96) and 0.82 (95% CI: 0.72, 0.91), respectively. CONCLUSION: The combination of imaging and clinical information improves outcome predictions. Supplemental material is available for this article. © RSNA, 2020 |
format | Online Article Text |
id | pubmed-7754832 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Radiological Society of North America |
record_format | MEDLINE/PubMed |
spelling | pubmed-77548322020-12-22 Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department Kwon, Young Joon (Fred) Toussie, Danielle Finkelstein, Mark Cedillo, Mario A. Maron, Samuel Z. Manna, Sayan Voutsinas, Nicholas Eber, Corey Jacobi, Adam Bernheim, Adam Gupta, Yogesh Sean Chung, Michael S. Fayad, Zahi A. Glicksberg, Benjamin S. Oermann, Eric K. Costa, Anthony B. Radiol Artif Intell Original Research PURPOSE: To train a deep learning classification algorithm to predict chest radiograph severity scores and clinical outcomes in patients with coronavirus disease 2019 (COVID-19). MATERIALS AND METHODS: In this retrospective cohort study, patients aged 21–50 years who presented to the emergency department (ED) of a multicenter urban health system from March 10 to 26, 2020, with COVID-19 confirmation at real-time reverse-transcription polymerase chain reaction screening were identified. The initial chest radiographs, clinical variables, and outcomes, including admission, intubation, and survival, were collected within 30 days (n = 338; median age, 39 years; 210 men). Two fellowship-trained cardiothoracic radiologists examined chest radiographs for opacities and assigned a clinically validated severity score. A deep learning algorithm was trained to predict outcomes on a holdout test set composed of patients with confirmed COVID-19 who presented between March 27 and 29, 2020 (n = 161; median age, 60 years; 98 men) for both younger (age range, 21–50 years; n = 51) and older (age >50 years, n = 110) populations. Bootstrapping was used to compute CIs. RESULTS: The model trained on the chest radiograph severity score produced the following areas under the receiver operating characteristic curves (AUCs): 0.80 (95% CI: 0.73, 0.88) for the chest radiograph severity score, 0.76 (95% CI: 0.68, 0.84) for admission, 0.66 (95% CI: 0.56, 0.75) for intubation, and 0.59 (95% CI: 0.49, 0.69) for death. The model trained on clinical variables produced an AUC of 0.64 (95% CI: 0.55, 0.73) for intubation and an AUC of 0.59 (95% CI: 0.50, 0.68) for death. Combining chest radiography and clinical variables increased the AUC of intubation and death to 0.88 (95% CI: 0.79, 0.96) and 0.82 (95% CI: 0.72, 0.91), respectively. CONCLUSION: The combination of imaging and clinical information improves outcome predictions. Supplemental material is available for this article. © RSNA, 2020 Radiological Society of North America 2020-12-16 /pmc/articles/PMC7754832/ /pubmed/33928257 http://dx.doi.org/10.1148/ryai.2020200098 Text en 2021 by the Radiological Society of North America, Inc. This article is made available via the PMC Open Access Subset for unrestricted re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the COVID-19 pandemic or until permissions are revoked in writing. Upon expiration of these permissions, PMC is granted a perpetual license to make this article available via PMC and Europe PMC, consistent with existing copyright protections. |
spellingShingle | Original Research Kwon, Young Joon (Fred) Toussie, Danielle Finkelstein, Mark Cedillo, Mario A. Maron, Samuel Z. Manna, Sayan Voutsinas, Nicholas Eber, Corey Jacobi, Adam Bernheim, Adam Gupta, Yogesh Sean Chung, Michael S. Fayad, Zahi A. Glicksberg, Benjamin S. Oermann, Eric K. Costa, Anthony B. Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department |
title | Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department |
title_full | Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department |
title_fullStr | Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department |
title_full_unstemmed | Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department |
title_short | Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department |
title_sort | combining initial radiographs and clinical variables improves deep learning prognostication in patients with covid-19 from the emergency department |
topic | Original Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7754832/ https://www.ncbi.nlm.nih.gov/pubmed/33928257 http://dx.doi.org/10.1148/ryai.2020200098 |
work_keys_str_mv | AT kwonyoungjoonfred combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT toussiedanielle combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT finkelsteinmark combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT cedillomarioa combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT maronsamuelz combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT mannasayan combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT voutsinasnicholas combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT ebercorey combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT jacobiadam combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT bernheimadam combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT guptayogeshsean combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT chungmichaels combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT fayadzahia combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT glicksbergbenjamins combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT oermannerick combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment AT costaanthonyb combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment |