Cargando…

Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department

PURPOSE: To train a deep learning classification algorithm to predict chest radiograph severity scores and clinical outcomes in patients with coronavirus disease 2019 (COVID-19). MATERIALS AND METHODS: In this retrospective cohort study, patients aged 21–50 years who presented to the emergency depar...

Descripción completa

Detalles Bibliográficos
Autores principales: Kwon, Young Joon (Fred), Toussie, Danielle, Finkelstein, Mark, Cedillo, Mario A., Maron, Samuel Z., Manna, Sayan, Voutsinas, Nicholas, Eber, Corey, Jacobi, Adam, Bernheim, Adam, Gupta, Yogesh Sean, Chung, Michael S., Fayad, Zahi A., Glicksberg, Benjamin S., Oermann, Eric K., Costa, Anthony B.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Radiological Society of North America 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7754832/
https://www.ncbi.nlm.nih.gov/pubmed/33928257
http://dx.doi.org/10.1148/ryai.2020200098
_version_ 1783626264648613888
author Kwon, Young Joon (Fred)
Toussie, Danielle
Finkelstein, Mark
Cedillo, Mario A.
Maron, Samuel Z.
Manna, Sayan
Voutsinas, Nicholas
Eber, Corey
Jacobi, Adam
Bernheim, Adam
Gupta, Yogesh Sean
Chung, Michael S.
Fayad, Zahi A.
Glicksberg, Benjamin S.
Oermann, Eric K.
Costa, Anthony B.
author_facet Kwon, Young Joon (Fred)
Toussie, Danielle
Finkelstein, Mark
Cedillo, Mario A.
Maron, Samuel Z.
Manna, Sayan
Voutsinas, Nicholas
Eber, Corey
Jacobi, Adam
Bernheim, Adam
Gupta, Yogesh Sean
Chung, Michael S.
Fayad, Zahi A.
Glicksberg, Benjamin S.
Oermann, Eric K.
Costa, Anthony B.
author_sort Kwon, Young Joon (Fred)
collection PubMed
description PURPOSE: To train a deep learning classification algorithm to predict chest radiograph severity scores and clinical outcomes in patients with coronavirus disease 2019 (COVID-19). MATERIALS AND METHODS: In this retrospective cohort study, patients aged 21–50 years who presented to the emergency department (ED) of a multicenter urban health system from March 10 to 26, 2020, with COVID-19 confirmation at real-time reverse-transcription polymerase chain reaction screening were identified. The initial chest radiographs, clinical variables, and outcomes, including admission, intubation, and survival, were collected within 30 days (n = 338; median age, 39 years; 210 men). Two fellowship-trained cardiothoracic radiologists examined chest radiographs for opacities and assigned a clinically validated severity score. A deep learning algorithm was trained to predict outcomes on a holdout test set composed of patients with confirmed COVID-19 who presented between March 27 and 29, 2020 (n = 161; median age, 60 years; 98 men) for both younger (age range, 21–50 years; n = 51) and older (age >50 years, n = 110) populations. Bootstrapping was used to compute CIs. RESULTS: The model trained on the chest radiograph severity score produced the following areas under the receiver operating characteristic curves (AUCs): 0.80 (95% CI: 0.73, 0.88) for the chest radiograph severity score, 0.76 (95% CI: 0.68, 0.84) for admission, 0.66 (95% CI: 0.56, 0.75) for intubation, and 0.59 (95% CI: 0.49, 0.69) for death. The model trained on clinical variables produced an AUC of 0.64 (95% CI: 0.55, 0.73) for intubation and an AUC of 0.59 (95% CI: 0.50, 0.68) for death. Combining chest radiography and clinical variables increased the AUC of intubation and death to 0.88 (95% CI: 0.79, 0.96) and 0.82 (95% CI: 0.72, 0.91), respectively. CONCLUSION: The combination of imaging and clinical information improves outcome predictions. Supplemental material is available for this article. © RSNA, 2020
format Online
Article
Text
id pubmed-7754832
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Radiological Society of North America
record_format MEDLINE/PubMed
spelling pubmed-77548322020-12-22 Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department Kwon, Young Joon (Fred) Toussie, Danielle Finkelstein, Mark Cedillo, Mario A. Maron, Samuel Z. Manna, Sayan Voutsinas, Nicholas Eber, Corey Jacobi, Adam Bernheim, Adam Gupta, Yogesh Sean Chung, Michael S. Fayad, Zahi A. Glicksberg, Benjamin S. Oermann, Eric K. Costa, Anthony B. Radiol Artif Intell Original Research PURPOSE: To train a deep learning classification algorithm to predict chest radiograph severity scores and clinical outcomes in patients with coronavirus disease 2019 (COVID-19). MATERIALS AND METHODS: In this retrospective cohort study, patients aged 21–50 years who presented to the emergency department (ED) of a multicenter urban health system from March 10 to 26, 2020, with COVID-19 confirmation at real-time reverse-transcription polymerase chain reaction screening were identified. The initial chest radiographs, clinical variables, and outcomes, including admission, intubation, and survival, were collected within 30 days (n = 338; median age, 39 years; 210 men). Two fellowship-trained cardiothoracic radiologists examined chest radiographs for opacities and assigned a clinically validated severity score. A deep learning algorithm was trained to predict outcomes on a holdout test set composed of patients with confirmed COVID-19 who presented between March 27 and 29, 2020 (n = 161; median age, 60 years; 98 men) for both younger (age range, 21–50 years; n = 51) and older (age >50 years, n = 110) populations. Bootstrapping was used to compute CIs. RESULTS: The model trained on the chest radiograph severity score produced the following areas under the receiver operating characteristic curves (AUCs): 0.80 (95% CI: 0.73, 0.88) for the chest radiograph severity score, 0.76 (95% CI: 0.68, 0.84) for admission, 0.66 (95% CI: 0.56, 0.75) for intubation, and 0.59 (95% CI: 0.49, 0.69) for death. The model trained on clinical variables produced an AUC of 0.64 (95% CI: 0.55, 0.73) for intubation and an AUC of 0.59 (95% CI: 0.50, 0.68) for death. Combining chest radiography and clinical variables increased the AUC of intubation and death to 0.88 (95% CI: 0.79, 0.96) and 0.82 (95% CI: 0.72, 0.91), respectively. CONCLUSION: The combination of imaging and clinical information improves outcome predictions. Supplemental material is available for this article. © RSNA, 2020 Radiological Society of North America 2020-12-16 /pmc/articles/PMC7754832/ /pubmed/33928257 http://dx.doi.org/10.1148/ryai.2020200098 Text en 2021 by the Radiological Society of North America, Inc. This article is made available via the PMC Open Access Subset for unrestricted re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the COVID-19 pandemic or until permissions are revoked in writing. Upon expiration of these permissions, PMC is granted a perpetual license to make this article available via PMC and Europe PMC, consistent with existing copyright protections.
spellingShingle Original Research
Kwon, Young Joon (Fred)
Toussie, Danielle
Finkelstein, Mark
Cedillo, Mario A.
Maron, Samuel Z.
Manna, Sayan
Voutsinas, Nicholas
Eber, Corey
Jacobi, Adam
Bernheim, Adam
Gupta, Yogesh Sean
Chung, Michael S.
Fayad, Zahi A.
Glicksberg, Benjamin S.
Oermann, Eric K.
Costa, Anthony B.
Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department
title Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department
title_full Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department
title_fullStr Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department
title_full_unstemmed Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department
title_short Combining Initial Radiographs and Clinical Variables Improves Deep Learning Prognostication in Patients with COVID-19 from the Emergency Department
title_sort combining initial radiographs and clinical variables improves deep learning prognostication in patients with covid-19 from the emergency department
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7754832/
https://www.ncbi.nlm.nih.gov/pubmed/33928257
http://dx.doi.org/10.1148/ryai.2020200098
work_keys_str_mv AT kwonyoungjoonfred combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT toussiedanielle combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT finkelsteinmark combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT cedillomarioa combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT maronsamuelz combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT mannasayan combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT voutsinasnicholas combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT ebercorey combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT jacobiadam combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT bernheimadam combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT guptayogeshsean combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT chungmichaels combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT fayadzahia combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT glicksbergbenjamins combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT oermannerick combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment
AT costaanthonyb combininginitialradiographsandclinicalvariablesimprovesdeeplearningprognosticationinpatientswithcovid19fromtheemergencydepartment