Cargando…
A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
BACKGROUND: Effectively and efficiently diagnosing patients who have COVID-19 with the accurate clinical type of the disease is essential to achieve optimal outcomes for the patients as well as to reduce the risk of overloading the health care system. Currently, severe and nonsevere COVID-19 types a...
Autores principales: | , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8030658/ https://www.ncbi.nlm.nih.gov/pubmed/33714935 http://dx.doi.org/10.2196/23948 |
_version_ | 1783676122295173120 |
---|---|
author | Chen, Yuanfang Ouyang, Liu Bao, Forrest S Li, Qian Han, Lei Zhang, Hengdong Zhu, Baoli Ge, Yaorong Robinson, Patrick Xu, Ming Liu, Jie Chen, Shi |
author_facet | Chen, Yuanfang Ouyang, Liu Bao, Forrest S Li, Qian Han, Lei Zhang, Hengdong Zhu, Baoli Ge, Yaorong Robinson, Patrick Xu, Ming Liu, Jie Chen, Shi |
author_sort | Chen, Yuanfang |
collection | PubMed |
description | BACKGROUND: Effectively and efficiently diagnosing patients who have COVID-19 with the accurate clinical type of the disease is essential to achieve optimal outcomes for the patients as well as to reduce the risk of overloading the health care system. Currently, severe and nonsevere COVID-19 types are differentiated by only a few features, which do not comprehensively characterize the complicated pathological, physiological, and immunological responses to SARS-CoV-2 infection in the different disease types. In addition, these type-defining features may not be readily testable at the time of diagnosis. OBJECTIVE: In this study, we aimed to use a machine learning approach to understand COVID-19 more comprehensively, accurately differentiate severe and nonsevere COVID-19 clinical types based on multiple medical features, and provide reliable predictions of the clinical type of the disease. METHODS: For this study, we recruited 214 confirmed patients with nonsevere COVID-19 and 148 patients with severe COVID-19. The clinical characteristics (26 features) and laboratory test results (26 features) upon admission were acquired as two input modalities. Exploratory analyses demonstrated that these features differed substantially between two clinical types. Machine learning random forest models based on all the features in each modality as well as on the top 5 features in each modality combined were developed and validated to differentiate COVID-19 clinical types. RESULTS: Using clinical and laboratory results independently as input, the random forest models achieved >90% and >95% predictive accuracy, respectively. The importance scores of the input features were further evaluated, and the top 5 features from each modality were identified (age, hypertension, cardiovascular disease, gender, and diabetes for the clinical features modality, and dimerized plasmin fragment D, high sensitivity troponin I, absolute neutrophil count, interleukin 6, and lactate dehydrogenase for the laboratory testing modality, in descending order). Using these top 10 multimodal features as the only input instead of all 52 features combined, the random forest model was able to achieve 97% predictive accuracy. CONCLUSIONS: Our findings shed light on how the human body reacts to SARS-CoV-2 infection as a unit and provide insights on effectively evaluating the disease severity of patients with COVID-19 based on more common medical features when gold standard features are not available. We suggest that clinical information can be used as an initial screening tool for self-evaluation and triage, while laboratory test results should be applied when accuracy is the priority. |
format | Online Article Text |
id | pubmed-8030658 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-80306582021-05-07 A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation Chen, Yuanfang Ouyang, Liu Bao, Forrest S Li, Qian Han, Lei Zhang, Hengdong Zhu, Baoli Ge, Yaorong Robinson, Patrick Xu, Ming Liu, Jie Chen, Shi J Med Internet Res Original Paper BACKGROUND: Effectively and efficiently diagnosing patients who have COVID-19 with the accurate clinical type of the disease is essential to achieve optimal outcomes for the patients as well as to reduce the risk of overloading the health care system. Currently, severe and nonsevere COVID-19 types are differentiated by only a few features, which do not comprehensively characterize the complicated pathological, physiological, and immunological responses to SARS-CoV-2 infection in the different disease types. In addition, these type-defining features may not be readily testable at the time of diagnosis. OBJECTIVE: In this study, we aimed to use a machine learning approach to understand COVID-19 more comprehensively, accurately differentiate severe and nonsevere COVID-19 clinical types based on multiple medical features, and provide reliable predictions of the clinical type of the disease. METHODS: For this study, we recruited 214 confirmed patients with nonsevere COVID-19 and 148 patients with severe COVID-19. The clinical characteristics (26 features) and laboratory test results (26 features) upon admission were acquired as two input modalities. Exploratory analyses demonstrated that these features differed substantially between two clinical types. Machine learning random forest models based on all the features in each modality as well as on the top 5 features in each modality combined were developed and validated to differentiate COVID-19 clinical types. RESULTS: Using clinical and laboratory results independently as input, the random forest models achieved >90% and >95% predictive accuracy, respectively. The importance scores of the input features were further evaluated, and the top 5 features from each modality were identified (age, hypertension, cardiovascular disease, gender, and diabetes for the clinical features modality, and dimerized plasmin fragment D, high sensitivity troponin I, absolute neutrophil count, interleukin 6, and lactate dehydrogenase for the laboratory testing modality, in descending order). Using these top 10 multimodal features as the only input instead of all 52 features combined, the random forest model was able to achieve 97% predictive accuracy. CONCLUSIONS: Our findings shed light on how the human body reacts to SARS-CoV-2 infection as a unit and provide insights on effectively evaluating the disease severity of patients with COVID-19 based on more common medical features when gold standard features are not available. We suggest that clinical information can be used as an initial screening tool for self-evaluation and triage, while laboratory test results should be applied when accuracy is the priority. JMIR Publications 2021-04-07 /pmc/articles/PMC8030658/ /pubmed/33714935 http://dx.doi.org/10.2196/23948 Text en ©Yuanfang Chen, Liu Ouyang, Forrest S Bao, Qian Li, Lei Han, Hengdong Zhang, Baoli Zhu, Yaorong Ge, Patrick Robinson, Ming Xu, Jie Liu, Shi Chen. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 07.04.2021. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Chen, Yuanfang Ouyang, Liu Bao, Forrest S Li, Qian Han, Lei Zhang, Hengdong Zhu, Baoli Ge, Yaorong Robinson, Patrick Xu, Ming Liu, Jie Chen, Shi A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation |
title | A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation |
title_full | A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation |
title_fullStr | A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation |
title_full_unstemmed | A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation |
title_short | A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation |
title_sort | multimodality machine learning approach to differentiate severe and nonsevere covid-19: model development and validation |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8030658/ https://www.ncbi.nlm.nih.gov/pubmed/33714935 http://dx.doi.org/10.2196/23948 |
work_keys_str_mv | AT chenyuanfang amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT ouyangliu amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT baoforrests amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT liqian amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT hanlei amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT zhanghengdong amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT zhubaoli amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT geyaorong amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT robinsonpatrick amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT xuming amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT liujie amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT chenshi amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT chenyuanfang multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT ouyangliu multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT baoforrests multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT liqian multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT hanlei multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT zhanghengdong multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT zhubaoli multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT geyaorong multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT robinsonpatrick multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT xuming multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT liujie multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation AT chenshi multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation |