Cargando…
Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19
Despite the publication of great number of tools to aid decisions in COVID-19 patients, there is a lack of good instruments to predict clinical deterioration. COVID19-Osakidetza is a prospective cohort study recruiting COVID-19 patients. We collected information from baseline to discharge on: sociod...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9059444/ https://www.ncbi.nlm.nih.gov/pubmed/35501359 http://dx.doi.org/10.1038/s41598-022-09771-z |
_version_ | 1784698312637546496 |
---|---|
author | Garcia-Gutiérrez, Susana Esteban-Aizpiri, Cristobal Lafuente, Iratxe Barrio, Irantzu Quiros, Raul Quintana, Jose Maria Uranga, Ane |
author_facet | Garcia-Gutiérrez, Susana Esteban-Aizpiri, Cristobal Lafuente, Iratxe Barrio, Irantzu Quiros, Raul Quintana, Jose Maria Uranga, Ane |
author_sort | Garcia-Gutiérrez, Susana |
collection | PubMed |
description | Despite the publication of great number of tools to aid decisions in COVID-19 patients, there is a lack of good instruments to predict clinical deterioration. COVID19-Osakidetza is a prospective cohort study recruiting COVID-19 patients. We collected information from baseline to discharge on: sociodemographic characteristics, comorbidities and associated medications, vital signs, treatment received and lab test results. Outcome was need for intensive ventilatory support (with at least standard high-flow oxygen face mask with a reservoir bag for at least 6 h and need for more intensive therapy afterwards or Optiflow high-flow nasal cannula or noninvasive or invasive mechanical ventilation) and/or admission to a critical care unit and/or death during hospitalization. We developed a Catboost model summarizing the findings using Shapley Additive Explanations. Performance of the model was assessed using area under the receiver operating characteristic and prediction recall curves (AUROC and AUPRC respectively) and calibrated using the Hosmer–Lemeshow test. Overall, 1568 patients were included in the derivation cohort and 956 in the (external) validation cohort. The percentages of patients who reached the composite endpoint were 23.3% vs 20% respectively. The strongest predictors of clinical deterioration were arterial blood oxygen pressure, followed by age, levels of several markers of inflammation (procalcitonin, LDH, CRP) and alterations in blood count and coagulation. Some medications, namely, ATC AO2 (antiacids) and N05 (neuroleptics) were also among the group of main predictors, together with C03 (diuretics). In the validation set, the CatBoost AUROC was 0.79, AUPRC 0.21 and Hosmer–Lemeshow test statistic 0.36. We present a machine learning-based prediction model with excellent performance properties to implement in EHRs. Our main goal was to predict progression to a score of 5 or higher on the WHO Clinical Progression Scale before patients required mechanical ventilation. Future steps are to externally validate the model in other settings and in a cohort from a different period and to apply the algorithm in clinical practice. Registration: ClinicalTrials.gov Identifier: NCT04463706. |
format | Online Article Text |
id | pubmed-9059444 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-90594442022-05-02 Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 Garcia-Gutiérrez, Susana Esteban-Aizpiri, Cristobal Lafuente, Iratxe Barrio, Irantzu Quiros, Raul Quintana, Jose Maria Uranga, Ane Sci Rep Article Despite the publication of great number of tools to aid decisions in COVID-19 patients, there is a lack of good instruments to predict clinical deterioration. COVID19-Osakidetza is a prospective cohort study recruiting COVID-19 patients. We collected information from baseline to discharge on: sociodemographic characteristics, comorbidities and associated medications, vital signs, treatment received and lab test results. Outcome was need for intensive ventilatory support (with at least standard high-flow oxygen face mask with a reservoir bag for at least 6 h and need for more intensive therapy afterwards or Optiflow high-flow nasal cannula or noninvasive or invasive mechanical ventilation) and/or admission to a critical care unit and/or death during hospitalization. We developed a Catboost model summarizing the findings using Shapley Additive Explanations. Performance of the model was assessed using area under the receiver operating characteristic and prediction recall curves (AUROC and AUPRC respectively) and calibrated using the Hosmer–Lemeshow test. Overall, 1568 patients were included in the derivation cohort and 956 in the (external) validation cohort. The percentages of patients who reached the composite endpoint were 23.3% vs 20% respectively. The strongest predictors of clinical deterioration were arterial blood oxygen pressure, followed by age, levels of several markers of inflammation (procalcitonin, LDH, CRP) and alterations in blood count and coagulation. Some medications, namely, ATC AO2 (antiacids) and N05 (neuroleptics) were also among the group of main predictors, together with C03 (diuretics). In the validation set, the CatBoost AUROC was 0.79, AUPRC 0.21 and Hosmer–Lemeshow test statistic 0.36. We present a machine learning-based prediction model with excellent performance properties to implement in EHRs. Our main goal was to predict progression to a score of 5 or higher on the WHO Clinical Progression Scale before patients required mechanical ventilation. Future steps are to externally validate the model in other settings and in a cohort from a different period and to apply the algorithm in clinical practice. Registration: ClinicalTrials.gov Identifier: NCT04463706. Nature Publishing Group UK 2022-05-02 /pmc/articles/PMC9059444/ /pubmed/35501359 http://dx.doi.org/10.1038/s41598-022-09771-z Text en © The Author(s) 2022, corrected publication 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Garcia-Gutiérrez, Susana Esteban-Aizpiri, Cristobal Lafuente, Iratxe Barrio, Irantzu Quiros, Raul Quintana, Jose Maria Uranga, Ane Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 |
title | Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 |
title_full | Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 |
title_fullStr | Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 |
title_full_unstemmed | Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 |
title_short | Machine learning-based model for prediction of clinical deterioration in hospitalized patients by COVID 19 |
title_sort | machine learning-based model for prediction of clinical deterioration in hospitalized patients by covid 19 |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9059444/ https://www.ncbi.nlm.nih.gov/pubmed/35501359 http://dx.doi.org/10.1038/s41598-022-09771-z |
work_keys_str_mv | AT garciagutierrezsusana machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 AT estebanaizpiricristobal machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 AT lafuenteiratxe machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 AT barrioirantzu machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 AT quirosraul machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 AT quintanajosemaria machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 AT urangaane machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 AT machinelearningbasedmodelforpredictionofclinicaldeteriorationinhospitalizedpatientsbycovid19 |