Cargando…

An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study

BACKGROUND: Prioritizing patients in need of intensive care is necessary to reduce the mortality rate during the COVID-19 pandemic. Although several scoring methods have been introduced, many require laboratory or radiographic findings that are not always easily available. OBJECTIVE: The purpose of...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Hyung-Jun, Han, Deokjae, Kim, Jeong-Han, Kim, Daehyun, Ha, Beomman, Seog, Woong, Lee, Yeon-Kyeng, Lim, Dosang, Hong, Sung Ok, Park, Mi-Jin, Heo, JoonNyung
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7655730/
https://www.ncbi.nlm.nih.gov/pubmed/33108316
http://dx.doi.org/10.2196/24225
_version_ 1783608234063429632
author Kim, Hyung-Jun
Han, Deokjae
Kim, Jeong-Han
Kim, Daehyun
Ha, Beomman
Seog, Woong
Lee, Yeon-Kyeng
Lim, Dosang
Hong, Sung Ok
Park, Mi-Jin
Heo, JoonNyung
author_facet Kim, Hyung-Jun
Han, Deokjae
Kim, Jeong-Han
Kim, Daehyun
Ha, Beomman
Seog, Woong
Lee, Yeon-Kyeng
Lim, Dosang
Hong, Sung Ok
Park, Mi-Jin
Heo, JoonNyung
author_sort Kim, Hyung-Jun
collection PubMed
description BACKGROUND: Prioritizing patients in need of intensive care is necessary to reduce the mortality rate during the COVID-19 pandemic. Although several scoring methods have been introduced, many require laboratory or radiographic findings that are not always easily available. OBJECTIVE: The purpose of this study was to develop a machine learning model that predicts the need for intensive care for patients with COVID-19 using easily obtainable characteristics—baseline demographics, comorbidities, and symptoms. METHODS: A retrospective study was performed using a nationwide cohort in South Korea. Patients admitted to 100 hospitals from January 25, 2020, to June 3, 2020, were included. Patient information was collected retrospectively by the attending physicians in each hospital and uploaded to an online case report form. Variables that could be easily provided were extracted. The variables were age, sex, smoking history, body temperature, comorbidities, activities of daily living, and symptoms. The primary outcome was the need for intensive care, defined as admission to the intensive care unit, use of extracorporeal life support, mechanical ventilation, vasopressors, or death within 30 days of hospitalization. Patients admitted until March 20, 2020, were included in the derivation group to develop prediction models using an automated machine learning technique. The models were externally validated in patients admitted after March 21, 2020. The machine learning model with the best discrimination performance was selected and compared against the CURB-65 (confusion, urea, respiratory rate, blood pressure, and 65 years of age or older) score using the area under the receiver operating characteristic curve (AUC). RESULTS: A total of 4787 patients were included in the analysis, of which 3294 were assigned to the derivation group and 1493 to the validation group. Among the 4787 patients, 460 (9.6%) patients needed intensive care. Of the 55 machine learning models developed, the XGBoost model revealed the highest discrimination performance. The AUC of the XGBoost model was 0.897 (95% CI 0.877-0.917) for the derivation group and 0.885 (95% CI 0.855-0.915) for the validation group. Both the AUCs were superior to those of CURB-65, which were 0.836 (95% CI 0.825-0.847) and 0.843 (95% CI 0.829-0.857), respectively. CONCLUSIONS: We developed a machine learning model comprising simple patient-provided characteristics, which can efficiently predict the need for intensive care among patients with COVID-19.
format Online
Article
Text
id pubmed-7655730
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-76557302020-11-13 An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study Kim, Hyung-Jun Han, Deokjae Kim, Jeong-Han Kim, Daehyun Ha, Beomman Seog, Woong Lee, Yeon-Kyeng Lim, Dosang Hong, Sung Ok Park, Mi-Jin Heo, JoonNyung J Med Internet Res Original Paper BACKGROUND: Prioritizing patients in need of intensive care is necessary to reduce the mortality rate during the COVID-19 pandemic. Although several scoring methods have been introduced, many require laboratory or radiographic findings that are not always easily available. OBJECTIVE: The purpose of this study was to develop a machine learning model that predicts the need for intensive care for patients with COVID-19 using easily obtainable characteristics—baseline demographics, comorbidities, and symptoms. METHODS: A retrospective study was performed using a nationwide cohort in South Korea. Patients admitted to 100 hospitals from January 25, 2020, to June 3, 2020, were included. Patient information was collected retrospectively by the attending physicians in each hospital and uploaded to an online case report form. Variables that could be easily provided were extracted. The variables were age, sex, smoking history, body temperature, comorbidities, activities of daily living, and symptoms. The primary outcome was the need for intensive care, defined as admission to the intensive care unit, use of extracorporeal life support, mechanical ventilation, vasopressors, or death within 30 days of hospitalization. Patients admitted until March 20, 2020, were included in the derivation group to develop prediction models using an automated machine learning technique. The models were externally validated in patients admitted after March 21, 2020. The machine learning model with the best discrimination performance was selected and compared against the CURB-65 (confusion, urea, respiratory rate, blood pressure, and 65 years of age or older) score using the area under the receiver operating characteristic curve (AUC). RESULTS: A total of 4787 patients were included in the analysis, of which 3294 were assigned to the derivation group and 1493 to the validation group. Among the 4787 patients, 460 (9.6%) patients needed intensive care. Of the 55 machine learning models developed, the XGBoost model revealed the highest discrimination performance. The AUC of the XGBoost model was 0.897 (95% CI 0.877-0.917) for the derivation group and 0.885 (95% CI 0.855-0.915) for the validation group. Both the AUCs were superior to those of CURB-65, which were 0.836 (95% CI 0.825-0.847) and 0.843 (95% CI 0.829-0.857), respectively. CONCLUSIONS: We developed a machine learning model comprising simple patient-provided characteristics, which can efficiently predict the need for intensive care among patients with COVID-19. JMIR Publications 2020-11-09 /pmc/articles/PMC7655730/ /pubmed/33108316 http://dx.doi.org/10.2196/24225 Text en ©Hyung-Jun Kim, Deokjae Han, Jeong-Han Kim, Daehyun Kim, Beomman Ha, Woong Seog, Yeon-Kyeng Lee, Dosang Lim, Sung Ok Hong, Mi-Jin Park, JoonNyung Heo. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 09.11.2020. https://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Kim, Hyung-Jun
Han, Deokjae
Kim, Jeong-Han
Kim, Daehyun
Ha, Beomman
Seog, Woong
Lee, Yeon-Kyeng
Lim, Dosang
Hong, Sung Ok
Park, Mi-Jin
Heo, JoonNyung
An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study
title An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study
title_full An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study
title_fullStr An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study
title_full_unstemmed An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study
title_short An Easy-to-Use Machine Learning Model to Predict the Prognosis of Patients With COVID-19: Retrospective Cohort Study
title_sort easy-to-use machine learning model to predict the prognosis of patients with covid-19: retrospective cohort study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7655730/
https://www.ncbi.nlm.nih.gov/pubmed/33108316
http://dx.doi.org/10.2196/24225
work_keys_str_mv AT kimhyungjun aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT handeokjae aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT kimjeonghan aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT kimdaehyun aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT habeomman aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT seogwoong aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT leeyeonkyeng aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT limdosang aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT hongsungok aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT parkmijin aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT heojoonnyung aneasytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT kimhyungjun easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT handeokjae easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT kimjeonghan easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT kimdaehyun easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT habeomman easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT seogwoong easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT leeyeonkyeng easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT limdosang easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT hongsungok easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT parkmijin easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy
AT heojoonnyung easytousemachinelearningmodeltopredicttheprognosisofpatientswithcovid19retrospectivecohortstudy