Cargando…

Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study

OBJECTIVE: The spread of coronavirus disease 2019 (COVID-19) has led to severe strain on hospital capacity in many countries. We aim to develop a model helping planners assess expected COVID-19 hospital resource utilization based on individual patient characteristics. MATERIALS AND METHODS: We devel...

Descripción completa

Detalles Bibliográficos
Autores principales: Roimi, Michael, Gutman, Rom, Somer, Jonathan, Ben Arie, Asaf, Calman, Ido, Bar-Lavie, Yaron, Gelbshtein, Udi, Liverant-Taub, Sigal, Ziv, Arnona, Eytan, Danny, Gorfine, Malka, Shalit, Uri
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7928913/
https://www.ncbi.nlm.nih.gov/pubmed/33479727
http://dx.doi.org/10.1093/jamia/ocab005
_version_ 1783659904094961664
author Roimi, Michael
Gutman, Rom
Somer, Jonathan
Ben Arie, Asaf
Calman, Ido
Bar-Lavie, Yaron
Gelbshtein, Udi
Liverant-Taub, Sigal
Ziv, Arnona
Eytan, Danny
Gorfine, Malka
Shalit, Uri
author_facet Roimi, Michael
Gutman, Rom
Somer, Jonathan
Ben Arie, Asaf
Calman, Ido
Bar-Lavie, Yaron
Gelbshtein, Udi
Liverant-Taub, Sigal
Ziv, Arnona
Eytan, Danny
Gorfine, Malka
Shalit, Uri
author_sort Roimi, Michael
collection PubMed
description OBJECTIVE: The spread of coronavirus disease 2019 (COVID-19) has led to severe strain on hospital capacity in many countries. We aim to develop a model helping planners assess expected COVID-19 hospital resource utilization based on individual patient characteristics. MATERIALS AND METHODS: We develop a model of patient clinical course based on an advanced multistate survival model. The model predicts the patient's disease course in terms of clinical states—critical, severe, or moderate. The model also predicts hospital utilization on the level of entire hospitals or healthcare systems. We cross-validated the model using a nationwide registry following the day-by-day clinical status of all hospitalized COVID-19 patients in Israel from March 1 to May 2, 2020 (n = 2703). RESULTS: Per-day mean absolute errors for predicted total and critical care hospital bed utilization were 4.72 ± 1.07 and 1.68 ± 0.40, respectively, over cohorts of 330 hospitalized patients; areas under the curve for prediction of critical illness and in-hospital mortality were 0.88 ± 0.04 and 0.96 ± 0.04, respectively. We further present the impact of patient influx scenarios on day-by-day healthcare system utilization. We provide an accompanying R software package. DISCUSSION: The proposed model accurately predicts total and critical care hospital utilization. The model enables evaluating impacts of patient influx scenarios on utilization, accounting for the state of currently hospitalized patients and characteristics of incoming patients. We show that accurate hospital load predictions were possible using only a patient’s age, sex, and day-by-day clinical state (critical, severe, or moderate). CONCLUSIONS: The multistate model we develop is a powerful tool for predicting individual-level patient outcomes and hospital-level utilization.
format Online
Article
Text
id pubmed-7928913
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-79289132021-03-04 Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study Roimi, Michael Gutman, Rom Somer, Jonathan Ben Arie, Asaf Calman, Ido Bar-Lavie, Yaron Gelbshtein, Udi Liverant-Taub, Sigal Ziv, Arnona Eytan, Danny Gorfine, Malka Shalit, Uri J Am Med Inform Assoc Research and Applications OBJECTIVE: The spread of coronavirus disease 2019 (COVID-19) has led to severe strain on hospital capacity in many countries. We aim to develop a model helping planners assess expected COVID-19 hospital resource utilization based on individual patient characteristics. MATERIALS AND METHODS: We develop a model of patient clinical course based on an advanced multistate survival model. The model predicts the patient's disease course in terms of clinical states—critical, severe, or moderate. The model also predicts hospital utilization on the level of entire hospitals or healthcare systems. We cross-validated the model using a nationwide registry following the day-by-day clinical status of all hospitalized COVID-19 patients in Israel from March 1 to May 2, 2020 (n = 2703). RESULTS: Per-day mean absolute errors for predicted total and critical care hospital bed utilization were 4.72 ± 1.07 and 1.68 ± 0.40, respectively, over cohorts of 330 hospitalized patients; areas under the curve for prediction of critical illness and in-hospital mortality were 0.88 ± 0.04 and 0.96 ± 0.04, respectively. We further present the impact of patient influx scenarios on day-by-day healthcare system utilization. We provide an accompanying R software package. DISCUSSION: The proposed model accurately predicts total and critical care hospital utilization. The model enables evaluating impacts of patient influx scenarios on utilization, accounting for the state of currently hospitalized patients and characteristics of incoming patients. We show that accurate hospital load predictions were possible using only a patient’s age, sex, and day-by-day clinical state (critical, severe, or moderate). CONCLUSIONS: The multistate model we develop is a powerful tool for predicting individual-level patient outcomes and hospital-level utilization. Oxford University Press 2021-02-26 /pmc/articles/PMC7928913/ /pubmed/33479727 http://dx.doi.org/10.1093/jamia/ocab005 Text en © The Author(s) 2021. Published by Oxford University Press on behalf of the American Medical Informatics Association. https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) ), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com
spellingShingle Research and Applications
Roimi, Michael
Gutman, Rom
Somer, Jonathan
Ben Arie, Asaf
Calman, Ido
Bar-Lavie, Yaron
Gelbshtein, Udi
Liverant-Taub, Sigal
Ziv, Arnona
Eytan, Danny
Gorfine, Malka
Shalit, Uri
Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study
title Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study
title_full Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study
title_fullStr Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study
title_full_unstemmed Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study
title_short Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study
title_sort development and validation of a machine learning model predicting illness trajectory and hospital utilization of covid-19 patients: a nationwide study
topic Research and Applications
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7928913/
https://www.ncbi.nlm.nih.gov/pubmed/33479727
http://dx.doi.org/10.1093/jamia/ocab005
work_keys_str_mv AT roimimichael developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT gutmanrom developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT somerjonathan developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT benarieasaf developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT calmanido developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT barlavieyaron developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT gelbshteinudi developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT liveranttaubsigal developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT zivarnona developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT eytandanny developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT gorfinemalka developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy
AT shalituri developmentandvalidationofamachinelearningmodelpredictingillnesstrajectoryandhospitalutilizationofcovid19patientsanationwidestudy