Cargando…
An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study
BACKGROUND: Prioritizing patients in need of intensive care is necessary to reduce the mortality rate during the COVID-19 pandemic. Although several scoring methods have been introduced, many require laboratory or radiographic findings that are not always easily available. OBJECTIVE: The purpose of...
Autores principales: | , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7655730/ https://www.ncbi.nlm.nih.gov/pubmed/33108316 http://dx.doi.org/10.2196/24225 |
_version_ | 1783608234063429632 |
---|---|
author | Kim, Hyung-Jun Han, Deokjae Kim, Jeong-Han Kim, Daehyun Ha, Beomman Seog, Woong Lee, Yeon-Kyeng Lim, Dosang Hong, Sung Ok Park, Mi-Jin Heo, JoonNyung |
author_facet | Kim, Hyung-Jun Han, Deokjae Kim, Jeong-Han Kim, Daehyun Ha, Beomman Seog, Woong Lee, Yeon-Kyeng Lim, Dosang Hong, Sung Ok Park, Mi-Jin Heo, JoonNyung |
author_sort | Kim, Hyung-Jun |
collection | PubMed |
description | BACKGROUND: Prioritizing patients in need of intensive care is necessary to reduce the mortality rate during the COVID-19 pandemic. Although several scoring methods have been introduced, many require laboratory or radiographic findings that are not always easily available. OBJECTIVE: The purpose of this study was to develop a machine learning model that predicts the need for intensive care for patients with COVID-19 using easily obtainable characteristics—baseline demographics, comorbidities, and symptoms. METHODS: A retrospective study was performed using a nationwide cohort in South Korea. Patients admitted to 100 hospitals from January 25, 2020, to June 3, 2020, were included. Patient information was collected retrospectively by the attending physicians in each hospital and uploaded to an online case report form. Variables that could be easily provided were extracted. The variables were age, sex, smoking history, body temperature, comorbidities, activities of daily living, and symptoms. The primary outcome was the need for intensive care, defined as admission to the intensive care unit, use of extracorporeal life support, mechanical ventilation, vasopressors, or death within 30 days of hospitalization. Patients admitted until March 20, 2020, were included in the derivation group to develop prediction models using an automated machine learning technique. The models were externally validated in patients admitted after March 21, 2020. The machine learning model with the best discrimination performance was selected and compared against the CURB-65 (confusion, urea, respiratory rate, blood pressure, and 65 years of age or older) score using the area under the receiver operating characteristic curve (AUC). RESULTS: A total of 4787 patients were included in the analysis, of which 3294 were assigned to the derivation group and 1493 to the validation group. Among the 4787 patients, 460 (9.6%) patients needed intensive care. Of the 55 machine learning models developed, the XGBoost model revealed the highest discrimination performance. The AUC of the XGBoost model was 0.897 (95% CI 0.877-0.917) for the derivation group and 0.885 (95% CI 0.855-0.915) for the validation group. Both the AUCs were superior to those of CURB-65, which were 0.836 (95% CI 0.825-0.847) and 0.843 (95% CI 0.829-0.857), respectively. CONCLUSIONS: We developed a machine learning model comprising simple patient-provided characteristics, which can efficiently predict the need for intensive care among patients with COVID-19. |
format | Online Article Text |
id | pubmed-7655730 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-76557302020-11-13 An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study Kim, Hyung-Jun Han, Deokjae Kim, Jeong-Han Kim, Daehyun Ha, Beomman Seog, Woong Lee, Yeon-Kyeng Lim, Dosang Hong, Sung Ok Park, Mi-Jin Heo, JoonNyung J Med Internet Res Original Paper BACKGROUND: Prioritizing patients in need of intensive care is necessary to reduce the mortality rate during the COVID-19 pandemic. Although several scoring methods have been introduced, many require laboratory or radiographic findings that are not always easily available. OBJECTIVE: The purpose of this study was to develop a machine learning model that predicts the need for intensive care for patients with COVID-19 using easily obtainable characteristics—baseline demographics, comorbidities, and symptoms. METHODS: A retrospective study was performed using a nationwide cohort in South Korea. Patients admitted to 100 hospitals from January 25, 2020, to June 3, 2020, were included. Patient information was collected retrospectively by the attending physicians in each hospital and uploaded to an online case report form. Variables that could be easily provided were extracted. The variables were age, sex, smoking history, body temperature, comorbidities, activities of daily living, and symptoms. The primary outcome was the need for intensive care, defined as admission to the intensive care unit, use of extracorporeal life support, mechanical ventilation, vasopressors, or death within 30 days of hospitalization. Patients admitted until March 20, 2020, were included in the derivation group to develop prediction models using an automated machine learning technique. The models were externally validated in patients admitted after March 21, 2020. The machine learning model with the best discrimination performance was selected and compared against the CURB-65 (confusion, urea, respiratory rate, blood pressure, and 65 years of age or older) score using the area under the receiver operating characteristic curve (AUC). RESULTS: A total of 4787 patients were included in the analysis, of which 3294 were assigned to the derivation group and 1493 to the validation group. Among the 4787 patients, 460 (9.6%) patients needed intensive care. Of the 55 machine learning models developed, the XGBoost model revealed the highest discrimination performance. The AUC of the XGBoost model was 0.897 (95% CI 0.877-0.917) for the derivation group and 0.885 (95% CI 0.855-0.915) for the validation group. Both the AUCs were superior to those of CURB-65, which were 0.836 (95% CI 0.825-0.847) and 0.843 (95% CI 0.829-0.857), respectively. CONCLUSIONS: We developed a machine learning model comprising simple patient-provided characteristics, which can efficiently predict the need for intensive care among patients with COVID-19. JMIR Publications 2020-11-09 /pmc/articles/PMC7655730/ /pubmed/33108316 http://dx.doi.org/10.2196/24225 Text en ©Hyung-Jun Kim, Deokjae Han, Jeong-Han Kim, Daehyun Kim, Beomman Ha, Woong Seog, Yeon-Kyeng Lee, Dosang Lim, Sung Ok Hong, Mi-Jin Park, JoonNyung Heo. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 09.11.2020. https://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Kim, Hyung-Jun Han, Deokjae Kim, Jeong-Han Kim, Daehyun Ha, Beomman Seog, Woong Lee, Yeon-Kyeng Lim, Dosang Hong, Sung Ok Park, Mi-Jin Heo, JoonNyung An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study |
title | An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study |
title_full | An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study |
title_fullStr | An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study |
title_full_unstemmed | An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study |
title_short | An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study |
title_sort | easy-to-use machine learning model to predict the prognosis of patients with covid-19: retrospective cohort study |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7655730/ https://www.ncbi.nlm.nih.gov/pubmed/33108316 http://dx.doi.org/10.2196/24225 |
work_keys_str_mv | AT kimhyungjun aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT handeokjae aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT kimjeonghan aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT kimdaehyun aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT habeomman aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT seogwoong aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT leeyeonkyeng aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT limdosang aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT hongsungok aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT parkmijin aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT heojoonnyung aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT kimhyungjun easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT handeokjae easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT kimjeonghan easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT kimdaehyun easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT habeomman easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT seogwoong easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT leeyeonkyeng easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT limdosang easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT hongsungok easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT parkmijin easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy AT heojoonnyung easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy |