Cargando…
Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data
OBJECTIVE: To develop a machine learning (ML) pipeline based on radiomics to predict Coronavirus Disease 2019 (COVID-19) severity and the future deterioration to critical illness using CT and clinical variables. MATERIALS AND METHODS: Clinical data were collected from 981 patients from a multi-insti...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The Korean Society of Radiology
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8236359/ https://www.ncbi.nlm.nih.gov/pubmed/33739635 http://dx.doi.org/10.3348/kjr.2020.1104 |
_version_ | 1783714520802263040 |
---|---|
author | Purkayastha, Subhanik Xiao, Yanhe Jiao, Zhicheng Thepumnoeysuk, Rujapa Halsey, Kasey Wu, Jing Tran, Thi My Linh Hsieh, Ben Choi, Ji Whae Wang, Dongcui Vallières, Martin Wang, Robin Collins, Scott Feng, Xue Feldman, Michael Zhang, Paul J. Atalay, Michael Sebro, Ronnie Yang, Li Fan, Yong Liao, Wei-hua Bai, Harrison X. |
author_facet | Purkayastha, Subhanik Xiao, Yanhe Jiao, Zhicheng Thepumnoeysuk, Rujapa Halsey, Kasey Wu, Jing Tran, Thi My Linh Hsieh, Ben Choi, Ji Whae Wang, Dongcui Vallières, Martin Wang, Robin Collins, Scott Feng, Xue Feldman, Michael Zhang, Paul J. Atalay, Michael Sebro, Ronnie Yang, Li Fan, Yong Liao, Wei-hua Bai, Harrison X. |
author_sort | Purkayastha, Subhanik |
collection | PubMed |
description | OBJECTIVE: To develop a machine learning (ML) pipeline based on radiomics to predict Coronavirus Disease 2019 (COVID-19) severity and the future deterioration to critical illness using CT and clinical variables. MATERIALS AND METHODS: Clinical data were collected from 981 patients from a multi-institutional international cohort with real-time polymerase chain reaction-confirmed COVID-19. Radiomics features were extracted from chest CT of the patients. The data of the cohort were randomly divided into training, validation, and test sets using a 7:1:2 ratio. A ML pipeline consisting of a model to predict severity and time-to-event model to predict progression to critical illness were trained on radiomics features and clinical variables. The receiver operating characteristic area under the curve (ROC-AUC), concordance index (C-index), and time-dependent ROC-AUC were calculated to determine model performance, which was compared with consensus CT severity scores obtained by visual interpretation by radiologists. RESULTS: Among 981 patients with confirmed COVID-19, 274 patients developed critical illness. Radiomics features and clinical variables resulted in the best performance for the prediction of disease severity with a highest test ROC-AUC of 0.76 compared with 0.70 (0.76 vs. 0.70, p = 0.023) for visual CT severity score and clinical variables. The progression prediction model achieved a test C-index of 0.868 when it was based on the combination of CT radiomics and clinical variables compared with 0.767 when based on CT radiomics features alone (p < 0.001), 0.847 when based on clinical variables alone (p = 0.110), and 0.860 when based on the combination of visual CT severity scores and clinical variables (p = 0.549). Furthermore, the model based on the combination of CT radiomics and clinical variables achieved time-dependent ROC-AUCs of 0.897, 0.933, and 0.927 for the prediction of progression risks at 3, 5 and 7 days, respectively. CONCLUSION: CT radiomics features combined with clinical variables were predictive of COVID-19 severity and progression to critical illness with fairly high accuracy. |
format | Online Article Text |
id | pubmed-8236359 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | The Korean Society of Radiology |
record_format | MEDLINE/PubMed |
spelling | pubmed-82363592021-07-07 Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data Purkayastha, Subhanik Xiao, Yanhe Jiao, Zhicheng Thepumnoeysuk, Rujapa Halsey, Kasey Wu, Jing Tran, Thi My Linh Hsieh, Ben Choi, Ji Whae Wang, Dongcui Vallières, Martin Wang, Robin Collins, Scott Feng, Xue Feldman, Michael Zhang, Paul J. Atalay, Michael Sebro, Ronnie Yang, Li Fan, Yong Liao, Wei-hua Bai, Harrison X. Korean J Radiol Thoracic Imaging OBJECTIVE: To develop a machine learning (ML) pipeline based on radiomics to predict Coronavirus Disease 2019 (COVID-19) severity and the future deterioration to critical illness using CT and clinical variables. MATERIALS AND METHODS: Clinical data were collected from 981 patients from a multi-institutional international cohort with real-time polymerase chain reaction-confirmed COVID-19. Radiomics features were extracted from chest CT of the patients. The data of the cohort were randomly divided into training, validation, and test sets using a 7:1:2 ratio. A ML pipeline consisting of a model to predict severity and time-to-event model to predict progression to critical illness were trained on radiomics features and clinical variables. The receiver operating characteristic area under the curve (ROC-AUC), concordance index (C-index), and time-dependent ROC-AUC were calculated to determine model performance, which was compared with consensus CT severity scores obtained by visual interpretation by radiologists. RESULTS: Among 981 patients with confirmed COVID-19, 274 patients developed critical illness. Radiomics features and clinical variables resulted in the best performance for the prediction of disease severity with a highest test ROC-AUC of 0.76 compared with 0.70 (0.76 vs. 0.70, p = 0.023) for visual CT severity score and clinical variables. The progression prediction model achieved a test C-index of 0.868 when it was based on the combination of CT radiomics and clinical variables compared with 0.767 when based on CT radiomics features alone (p < 0.001), 0.847 when based on clinical variables alone (p = 0.110), and 0.860 when based on the combination of visual CT severity scores and clinical variables (p = 0.549). Furthermore, the model based on the combination of CT radiomics and clinical variables achieved time-dependent ROC-AUCs of 0.897, 0.933, and 0.927 for the prediction of progression risks at 3, 5 and 7 days, respectively. CONCLUSION: CT radiomics features combined with clinical variables were predictive of COVID-19 severity and progression to critical illness with fairly high accuracy. The Korean Society of Radiology 2021-07 2021-03-09 /pmc/articles/PMC8236359/ /pubmed/33739635 http://dx.doi.org/10.3348/kjr.2020.1104 Text en Copyright © 2021 The Korean Society of Radiology https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) ) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Thoracic Imaging Purkayastha, Subhanik Xiao, Yanhe Jiao, Zhicheng Thepumnoeysuk, Rujapa Halsey, Kasey Wu, Jing Tran, Thi My Linh Hsieh, Ben Choi, Ji Whae Wang, Dongcui Vallières, Martin Wang, Robin Collins, Scott Feng, Xue Feldman, Michael Zhang, Paul J. Atalay, Michael Sebro, Ronnie Yang, Li Fan, Yong Liao, Wei-hua Bai, Harrison X. Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data |
title | Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data |
title_full | Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data |
title_fullStr | Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data |
title_full_unstemmed | Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data |
title_short | Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data |
title_sort | machine learning-based prediction of covid-19 severity and progression to critical illness using ct imaging and clinical data |
topic | Thoracic Imaging |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8236359/ https://www.ncbi.nlm.nih.gov/pubmed/33739635 http://dx.doi.org/10.3348/kjr.2020.1104 |
work_keys_str_mv | AT purkayasthasubhanik machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT xiaoyanhe machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT jiaozhicheng machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT thepumnoeysukrujapa machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT halseykasey machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT wujing machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT tranthimylinh machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT hsiehben machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT choijiwhae machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT wangdongcui machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT vallieresmartin machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT wangrobin machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT collinsscott machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT fengxue machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT feldmanmichael machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT zhangpaulj machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT atalaymichael machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT sebroronnie machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT yangli machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT fanyong machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT liaoweihua machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata AT baiharrisonx machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata |