Cargando…
A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2
BACKGROUND: This study aimed to explore whether explainable Artificial Intelligence methods can be fruitfully used to improve the medical management of patients suffering from complex diseases, and in particular to predict the death risk in hospitalized patients with SARS-Cov-2 based on admission da...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9795955/ https://www.ncbi.nlm.nih.gov/pubmed/36578017 http://dx.doi.org/10.1186/s12911-022-02076-1 |
_version_ | 1784860372174372864 |
---|---|
author | Bottrighi, Alessio Pennisi, Marzio Roveta, Annalisa Massarino, Costanza Cassinari, Antonella Betti, Marta Bolgeo, Tatiana Bertolotti, Marinella Rava, Emanuele Maconi, Antonio |
author_facet | Bottrighi, Alessio Pennisi, Marzio Roveta, Annalisa Massarino, Costanza Cassinari, Antonella Betti, Marta Bolgeo, Tatiana Bertolotti, Marinella Rava, Emanuele Maconi, Antonio |
author_sort | Bottrighi, Alessio |
collection | PubMed |
description | BACKGROUND: This study aimed to explore whether explainable Artificial Intelligence methods can be fruitfully used to improve the medical management of patients suffering from complex diseases, and in particular to predict the death risk in hospitalized patients with SARS-Cov-2 based on admission data. METHODS: This work is based on an observational ambispective study that comprised patients older than 18 years with a positive SARS-Cov-2 diagnosis that were admitted to the hospital Azienda Ospedaliera “SS Antonio e Biagio e Cesare Arrigo”, Alessandria, Italy from February, 24 2020 to May, 31 2021, and that completed the disease treatment inside this structure. The patients’medical history, demographic, epidemiologic and clinical data were collected from the electronic medical records system and paper based medical records, entered and managed by the Clinical Study Coordinators using the REDCap electronic data capture tool patient chart. The dataset was used to train and to evaluate predictive ML models. RESULTS: We overall trained, analysed and evaluated 19 predictive models (both supervised and unsupervised) on data from 824 patients described by 43 features. We focused our attention on models that provide an explanation that is understandable and directly usable by domain experts, and compared the results against other classical machine learning approaches. Among the former, JRIP showed the best performance in 10-fold cross validation, and the best average performance in a further validation test using a different patient dataset from the beginning of the third COVID-19 wave. Moreover, JRIP showed comparable performances with other approaches that do not provide a clear and/or understandable explanation. CONCLUSIONS: The ML supervised models showed to correctly discern between low-risk and high-risk patients, even when the medical disease context is complex and the list of features is limited to information available at admission time. Furthermore, the models demonstrated to reasonably perform on a dataset from the third COVID-19 wave that was not used in the training phase. Overall, these results are remarkable: (i) from a medical point of view, these models evaluate good predictions despite the possible differences entitled with different care protocols and the possible influence of other viral variants (i.e. delta variant); (ii) from the organizational point of view, they could be used to optimize the management of health-care path at the admission time. |
format | Online Article Text |
id | pubmed-9795955 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-97959552022-12-29 A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2 Bottrighi, Alessio Pennisi, Marzio Roveta, Annalisa Massarino, Costanza Cassinari, Antonella Betti, Marta Bolgeo, Tatiana Bertolotti, Marinella Rava, Emanuele Maconi, Antonio BMC Med Inform Decis Mak Research BACKGROUND: This study aimed to explore whether explainable Artificial Intelligence methods can be fruitfully used to improve the medical management of patients suffering from complex diseases, and in particular to predict the death risk in hospitalized patients with SARS-Cov-2 based on admission data. METHODS: This work is based on an observational ambispective study that comprised patients older than 18 years with a positive SARS-Cov-2 diagnosis that were admitted to the hospital Azienda Ospedaliera “SS Antonio e Biagio e Cesare Arrigo”, Alessandria, Italy from February, 24 2020 to May, 31 2021, and that completed the disease treatment inside this structure. The patients’medical history, demographic, epidemiologic and clinical data were collected from the electronic medical records system and paper based medical records, entered and managed by the Clinical Study Coordinators using the REDCap electronic data capture tool patient chart. The dataset was used to train and to evaluate predictive ML models. RESULTS: We overall trained, analysed and evaluated 19 predictive models (both supervised and unsupervised) on data from 824 patients described by 43 features. We focused our attention on models that provide an explanation that is understandable and directly usable by domain experts, and compared the results against other classical machine learning approaches. Among the former, JRIP showed the best performance in 10-fold cross validation, and the best average performance in a further validation test using a different patient dataset from the beginning of the third COVID-19 wave. Moreover, JRIP showed comparable performances with other approaches that do not provide a clear and/or understandable explanation. CONCLUSIONS: The ML supervised models showed to correctly discern between low-risk and high-risk patients, even when the medical disease context is complex and the list of features is limited to information available at admission time. Furthermore, the models demonstrated to reasonably perform on a dataset from the third COVID-19 wave that was not used in the training phase. Overall, these results are remarkable: (i) from a medical point of view, these models evaluate good predictions despite the possible differences entitled with different care protocols and the possible influence of other viral variants (i.e. delta variant); (ii) from the organizational point of view, they could be used to optimize the management of health-care path at the admission time. BioMed Central 2022-12-28 /pmc/articles/PMC9795955/ /pubmed/36578017 http://dx.doi.org/10.1186/s12911-022-02076-1 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Bottrighi, Alessio Pennisi, Marzio Roveta, Annalisa Massarino, Costanza Cassinari, Antonella Betti, Marta Bolgeo, Tatiana Bertolotti, Marinella Rava, Emanuele Maconi, Antonio A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2 |
title | A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2 |
title_full | A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2 |
title_fullStr | A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2 |
title_full_unstemmed | A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2 |
title_short | A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2 |
title_sort | machine learning approach for predicting high risk hospitalized patients with covid-19 sars-cov-2 |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9795955/ https://www.ncbi.nlm.nih.gov/pubmed/36578017 http://dx.doi.org/10.1186/s12911-022-02076-1 |
work_keys_str_mv | AT bottrighialessio amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT pennisimarzio amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT rovetaannalisa amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT massarinocostanza amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT cassinariantonella amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT bettimarta amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT bolgeotatiana amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT bertolottimarinella amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT ravaemanuele amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT maconiantonio amachinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT bottrighialessio machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT pennisimarzio machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT rovetaannalisa machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT massarinocostanza machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT cassinariantonella machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT bettimarta machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT bolgeotatiana machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT bertolottimarinella machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT ravaemanuele machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 AT maconiantonio machinelearningapproachforpredictinghighriskhospitalizedpatientswithcovid19sarscov2 |