Cargando…

Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data

OBJECTIVE: To develop a machine learning (ML) pipeline based on radiomics to predict Coronavirus Disease 2019 (COVID-19) severity and the future deterioration to critical illness using CT and clinical variables. MATERIALS AND METHODS: Clinical data were collected from 981 patients from a multi-insti...

Descripción completa

Detalles Bibliográficos
Autores principales: Purkayastha, Subhanik, Xiao, Yanhe, Jiao, Zhicheng, Thepumnoeysuk, Rujapa, Halsey, Kasey, Wu, Jing, Tran, Thi My Linh, Hsieh, Ben, Choi, Ji Whae, Wang, Dongcui, Vallières, Martin, Wang, Robin, Collins, Scott, Feng, Xue, Feldman, Michael, Zhang, Paul J., Atalay, Michael, Sebro, Ronnie, Yang, Li, Fan, Yong, Liao, Wei-hua, Bai, Harrison X.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Korean Society of Radiology 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8236359/
https://www.ncbi.nlm.nih.gov/pubmed/33739635
http://dx.doi.org/10.3348/kjr.2020.1104
_version_ 1783714520802263040
author Purkayastha, Subhanik
Xiao, Yanhe
Jiao, Zhicheng
Thepumnoeysuk, Rujapa
Halsey, Kasey
Wu, Jing
Tran, Thi My Linh
Hsieh, Ben
Choi, Ji Whae
Wang, Dongcui
Vallières, Martin
Wang, Robin
Collins, Scott
Feng, Xue
Feldman, Michael
Zhang, Paul J.
Atalay, Michael
Sebro, Ronnie
Yang, Li
Fan, Yong
Liao, Wei-hua
Bai, Harrison X.
author_facet Purkayastha, Subhanik
Xiao, Yanhe
Jiao, Zhicheng
Thepumnoeysuk, Rujapa
Halsey, Kasey
Wu, Jing
Tran, Thi My Linh
Hsieh, Ben
Choi, Ji Whae
Wang, Dongcui
Vallières, Martin
Wang, Robin
Collins, Scott
Feng, Xue
Feldman, Michael
Zhang, Paul J.
Atalay, Michael
Sebro, Ronnie
Yang, Li
Fan, Yong
Liao, Wei-hua
Bai, Harrison X.
author_sort Purkayastha, Subhanik
collection PubMed
description OBJECTIVE: To develop a machine learning (ML) pipeline based on radiomics to predict Coronavirus Disease 2019 (COVID-19) severity and the future deterioration to critical illness using CT and clinical variables. MATERIALS AND METHODS: Clinical data were collected from 981 patients from a multi-institutional international cohort with real-time polymerase chain reaction-confirmed COVID-19. Radiomics features were extracted from chest CT of the patients. The data of the cohort were randomly divided into training, validation, and test sets using a 7:1:2 ratio. A ML pipeline consisting of a model to predict severity and time-to-event model to predict progression to critical illness were trained on radiomics features and clinical variables. The receiver operating characteristic area under the curve (ROC-AUC), concordance index (C-index), and time-dependent ROC-AUC were calculated to determine model performance, which was compared with consensus CT severity scores obtained by visual interpretation by radiologists. RESULTS: Among 981 patients with confirmed COVID-19, 274 patients developed critical illness. Radiomics features and clinical variables resulted in the best performance for the prediction of disease severity with a highest test ROC-AUC of 0.76 compared with 0.70 (0.76 vs. 0.70, p = 0.023) for visual CT severity score and clinical variables. The progression prediction model achieved a test C-index of 0.868 when it was based on the combination of CT radiomics and clinical variables compared with 0.767 when based on CT radiomics features alone (p < 0.001), 0.847 when based on clinical variables alone (p = 0.110), and 0.860 when based on the combination of visual CT severity scores and clinical variables (p = 0.549). Furthermore, the model based on the combination of CT radiomics and clinical variables achieved time-dependent ROC-AUCs of 0.897, 0.933, and 0.927 for the prediction of progression risks at 3, 5 and 7 days, respectively. CONCLUSION: CT radiomics features combined with clinical variables were predictive of COVID-19 severity and progression to critical illness with fairly high accuracy.
format Online
Article
Text
id pubmed-8236359
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Korean Society of Radiology
record_format MEDLINE/PubMed
spelling pubmed-82363592021-07-07 Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data Purkayastha, Subhanik Xiao, Yanhe Jiao, Zhicheng Thepumnoeysuk, Rujapa Halsey, Kasey Wu, Jing Tran, Thi My Linh Hsieh, Ben Choi, Ji Whae Wang, Dongcui Vallières, Martin Wang, Robin Collins, Scott Feng, Xue Feldman, Michael Zhang, Paul J. Atalay, Michael Sebro, Ronnie Yang, Li Fan, Yong Liao, Wei-hua Bai, Harrison X. Korean J Radiol Thoracic Imaging OBJECTIVE: To develop a machine learning (ML) pipeline based on radiomics to predict Coronavirus Disease 2019 (COVID-19) severity and the future deterioration to critical illness using CT and clinical variables. MATERIALS AND METHODS: Clinical data were collected from 981 patients from a multi-institutional international cohort with real-time polymerase chain reaction-confirmed COVID-19. Radiomics features were extracted from chest CT of the patients. The data of the cohort were randomly divided into training, validation, and test sets using a 7:1:2 ratio. A ML pipeline consisting of a model to predict severity and time-to-event model to predict progression to critical illness were trained on radiomics features and clinical variables. The receiver operating characteristic area under the curve (ROC-AUC), concordance index (C-index), and time-dependent ROC-AUC were calculated to determine model performance, which was compared with consensus CT severity scores obtained by visual interpretation by radiologists. RESULTS: Among 981 patients with confirmed COVID-19, 274 patients developed critical illness. Radiomics features and clinical variables resulted in the best performance for the prediction of disease severity with a highest test ROC-AUC of 0.76 compared with 0.70 (0.76 vs. 0.70, p = 0.023) for visual CT severity score and clinical variables. The progression prediction model achieved a test C-index of 0.868 when it was based on the combination of CT radiomics and clinical variables compared with 0.767 when based on CT radiomics features alone (p < 0.001), 0.847 when based on clinical variables alone (p = 0.110), and 0.860 when based on the combination of visual CT severity scores and clinical variables (p = 0.549). Furthermore, the model based on the combination of CT radiomics and clinical variables achieved time-dependent ROC-AUCs of 0.897, 0.933, and 0.927 for the prediction of progression risks at 3, 5 and 7 days, respectively. CONCLUSION: CT radiomics features combined with clinical variables were predictive of COVID-19 severity and progression to critical illness with fairly high accuracy. The Korean Society of Radiology 2021-07 2021-03-09 /pmc/articles/PMC8236359/ /pubmed/33739635 http://dx.doi.org/10.3348/kjr.2020.1104 Text en Copyright © 2021 The Korean Society of Radiology https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) ) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Thoracic Imaging
Purkayastha, Subhanik
Xiao, Yanhe
Jiao, Zhicheng
Thepumnoeysuk, Rujapa
Halsey, Kasey
Wu, Jing
Tran, Thi My Linh
Hsieh, Ben
Choi, Ji Whae
Wang, Dongcui
Vallières, Martin
Wang, Robin
Collins, Scott
Feng, Xue
Feldman, Michael
Zhang, Paul J.
Atalay, Michael
Sebro, Ronnie
Yang, Li
Fan, Yong
Liao, Wei-hua
Bai, Harrison X.
Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data
title Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data
title_full Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data
title_fullStr Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data
title_full_unstemmed Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data
title_short Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data
title_sort machine learning-based prediction of covid-19 severity and progression to critical illness using ct imaging and clinical data
topic Thoracic Imaging
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8236359/
https://www.ncbi.nlm.nih.gov/pubmed/33739635
http://dx.doi.org/10.3348/kjr.2020.1104
work_keys_str_mv AT purkayasthasubhanik machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT xiaoyanhe machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT jiaozhicheng machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT thepumnoeysukrujapa machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT halseykasey machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT wujing machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT tranthimylinh machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT hsiehben machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT choijiwhae machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT wangdongcui machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT vallieresmartin machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT wangrobin machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT collinsscott machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT fengxue machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT feldmanmichael machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT zhangpaulj machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT atalaymichael machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT sebroronnie machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT yangli machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT fanyong machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT liaoweihua machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata
AT baiharrisonx machinelearningbasedpredictionofcovid19severityandprogressiontocriticalillnessusingctimagingandclinicaldata