Cargando…

Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19

Despite the publication of great number of tools to aid decisions in COVID-19 patients, there is a lack of good instruments to predict clinical deterioration. COVID19-Osakidetza is a prospective cohort study recruiting COVID-19 patients. We collected information from baseline to discharge on: sociod...

Descripción completa

Detalles Bibliográficos
Autores principales: Garcia-Gutiérrez, Susana, Esteban-Aizpiri, Cristobal, Lafuente, Iratxe, Barrio, Irantzu, Quiros, Raul, Quintana, Jose Maria, Uranga, Ane
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9059444/
https://www.ncbi.nlm.nih.gov/pubmed/35501359
http://dx.doi.org/10.1038/s41598-022-09771-z
_version_ 1784698312637546496
author Garcia-Gutiérrez, Susana
Esteban-Aizpiri, Cristobal
Lafuente, Iratxe
Barrio, Irantzu
Quiros, Raul
Quintana, Jose Maria
Uranga, Ane
author_facet Garcia-Gutiérrez, Susana
Esteban-Aizpiri, Cristobal
Lafuente, Iratxe
Barrio, Irantzu
Quiros, Raul
Quintana, Jose Maria
Uranga, Ane
author_sort Garcia-Gutiérrez, Susana
collection PubMed
description Despite the publication of great number of tools to aid decisions in COVID-19 patients, there is a lack of good instruments to predict clinical deterioration. COVID19-Osakidetza is a prospective cohort study recruiting COVID-19 patients. We collected information from baseline to discharge on: sociodemographic characteristics, comorbidities and associated medications, vital signs, treatment received and lab test results. Outcome was need for intensive ventilatory support (with at least standard high-flow oxygen face mask with a reservoir bag for at least 6 h and need for more intensive therapy afterwards or Optiflow high-flow nasal cannula or noninvasive or invasive mechanical ventilation) and/or admission to a critical care unit and/or death during hospitalization. We developed a Catboost model summarizing the findings using Shapley Additive Explanations. Performance of the model was assessed using area under the receiver operating characteristic and prediction recall curves (AUROC and AUPRC respectively) and calibrated using the Hosmer–Lemeshow test. Overall, 1568 patients were included in the derivation cohort and 956 in the (external) validation cohort. The percentages of patients who reached the composite endpoint were 23.3% vs 20% respectively. The strongest predictors of clinical deterioration were arterial blood oxygen pressure, followed by age, levels of several markers of inflammation (procalcitonin, LDH, CRP) and alterations in blood count and coagulation. Some medications, namely, ATC AO2 (antiacids) and N05 (neuroleptics) were also among the group of main predictors, together with C03 (diuretics). In the validation set, the CatBoost AUROC was 0.79, AUPRC 0.21 and Hosmer–Lemeshow test statistic 0.36. We present a machine learning-based prediction model with excellent performance properties to implement in EHRs. Our main goal was to predict progression to a score of 5 or higher on the WHO Clinical Progression Scale before patients required mechanical ventilation. Future steps are to externally validate the model in other settings and in a cohort from a different period and to apply the algorithm in clinical practice. Registration: ClinicalTrials.gov Identifier: NCT04463706.
format Online
Article
Text
id pubmed-9059444
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-90594442022-05-02 Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 Garcia-Gutiérrez, Susana Esteban-Aizpiri, Cristobal Lafuente, Iratxe Barrio, Irantzu Quiros, Raul Quintana, Jose Maria Uranga, Ane Sci Rep Article Despite the publication of great number of tools to aid decisions in COVID-19 patients, there is a lack of good instruments to predict clinical deterioration. COVID19-Osakidetza is a prospective cohort study recruiting COVID-19 patients. We collected information from baseline to discharge on: sociodemographic characteristics, comorbidities and associated medications, vital signs, treatment received and lab test results. Outcome was need for intensive ventilatory support (with at least standard high-flow oxygen face mask with a reservoir bag for at least 6 h and need for more intensive therapy afterwards or Optiflow high-flow nasal cannula or noninvasive or invasive mechanical ventilation) and/or admission to a critical care unit and/or death during hospitalization. We developed a Catboost model summarizing the findings using Shapley Additive Explanations. Performance of the model was assessed using area under the receiver operating characteristic and prediction recall curves (AUROC and AUPRC respectively) and calibrated using the Hosmer–Lemeshow test. Overall, 1568 patients were included in the derivation cohort and 956 in the (external) validation cohort. The percentages of patients who reached the composite endpoint were 23.3% vs 20% respectively. The strongest predictors of clinical deterioration were arterial blood oxygen pressure, followed by age, levels of several markers of inflammation (procalcitonin, LDH, CRP) and alterations in blood count and coagulation. Some medications, namely, ATC AO2 (antiacids) and N05 (neuroleptics) were also among the group of main predictors, together with C03 (diuretics). In the validation set, the CatBoost AUROC was 0.79, AUPRC 0.21 and Hosmer–Lemeshow test statistic 0.36. We present a machine learning-based prediction model with excellent performance properties to implement in EHRs. Our main goal was to predict progression to a score of 5 or higher on the WHO Clinical Progression Scale before patients required mechanical ventilation. Future steps are to externally validate the model in other settings and in a cohort from a different period and to apply the algorithm in clinical practice. Registration: ClinicalTrials.gov Identifier: NCT04463706. Nature Publishing Group UK 2022-05-02 /pmc/articles/PMC9059444/ /pubmed/35501359 http://dx.doi.org/10.1038/s41598-022-09771-z Text en © The Author(s) 2022, corrected publication 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Garcia-Gutiérrez, Susana
Esteban-Aizpiri, Cristobal
Lafuente, Iratxe
Barrio, Irantzu
Quiros, Raul
Quintana, Jose Maria
Uranga, Ane
Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19
title Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19
title_full Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19
title_fullStr Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19
title_full_unstemmed Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19
title_short Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19
title_sort machine learning-based model for prediction of clinical deterioration in hospitalized patients by covid 19
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9059444/
https://www.ncbi.nlm.nih.gov/pubmed/35501359
http://dx.doi.org/10.1038/s41598-022-09771-z
work_keys_str_mv AT garciagutierrezsusana machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19
AT estebanaizpiricristobal machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19
AT lafuenteiratxe machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19
AT barrioirantzu machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19
AT quirosraul machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19
AT quintanajosemaria machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19
AT urangaane machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19
AT machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19