Cargando…
Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study
BACKGROUND: Acute respiratory distress syndrome (ARDS) is a condition that is often considered to have broad and subjective diagnostic criteria and is associated with significant mortality and morbidity. Early and accurate prediction of ARDS and related conditions such as hypoxemia and sepsis could...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9244659/ https://www.ncbi.nlm.nih.gov/pubmed/35704370 http://dx.doi.org/10.2196/36202 |
_version_ | 1784738576729112576 |
---|---|
author | Lam, Carson Thapa, Rahul Maharjan, Jenish Rahmani, Keyvan Tso, Chak Foon Singh, Navan Preet Casie Chetty, Satish Mao, Qingqing |
author_facet | Lam, Carson Thapa, Rahul Maharjan, Jenish Rahmani, Keyvan Tso, Chak Foon Singh, Navan Preet Casie Chetty, Satish Mao, Qingqing |
author_sort | Lam, Carson |
collection | PubMed |
description | BACKGROUND: Acute respiratory distress syndrome (ARDS) is a condition that is often considered to have broad and subjective diagnostic criteria and is associated with significant mortality and morbidity. Early and accurate prediction of ARDS and related conditions such as hypoxemia and sepsis could allow timely administration of therapies, leading to improved patient outcomes. OBJECTIVE: The aim of this study is to perform an exploration of how multilabel classification in the clinical setting can take advantage of the underlying dependencies between ARDS and related conditions to improve early prediction of ARDS in patients. METHODS: The electronic health record data set included 40,703 patient encounters from 7 hospitals from April 20, 2018, to March 17, 2021. A recurrent neural network (RNN) was trained using data from 5 hospitals, and external validation was conducted on data from 2 hospitals. In addition to ARDS, 12 target labels for related conditions such as sepsis, hypoxemia, and COVID-19 were used to train the model to classify a total of 13 outputs. As a comparator, XGBoost models were developed for each of the 13 target labels. Model performance was assessed using the area under the receiver operating characteristic curve. Heat maps to visualize attention scores were generated to provide interpretability to the neural networks. Finally, cluster analysis was performed to identify potential phenotypic subgroups of patients with ARDS. RESULTS: The single RNN model trained to classify 13 outputs outperformed the individual XGBoost models for ARDS prediction, achieving an area under the receiver operating characteristic curve of 0.842 on the external test sets. Models trained on an increasing number of tasks resulted in improved performance. Earlier prediction of ARDS nearly doubled the rate of in-hospital survival. Cluster analysis revealed distinct ARDS subgroups, some of which had similar mortality rates but different clinical presentations. CONCLUSIONS: The RNN model presented in this paper can be used as an early warning system to stratify patients who are at risk of developing one of the multiple risk outcomes, hence providing practitioners with the means to take early action. |
format | Online Article Text |
id | pubmed-9244659 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-92446592022-07-01 Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study Lam, Carson Thapa, Rahul Maharjan, Jenish Rahmani, Keyvan Tso, Chak Foon Singh, Navan Preet Casie Chetty, Satish Mao, Qingqing JMIR Med Inform Original Paper BACKGROUND: Acute respiratory distress syndrome (ARDS) is a condition that is often considered to have broad and subjective diagnostic criteria and is associated with significant mortality and morbidity. Early and accurate prediction of ARDS and related conditions such as hypoxemia and sepsis could allow timely administration of therapies, leading to improved patient outcomes. OBJECTIVE: The aim of this study is to perform an exploration of how multilabel classification in the clinical setting can take advantage of the underlying dependencies between ARDS and related conditions to improve early prediction of ARDS in patients. METHODS: The electronic health record data set included 40,703 patient encounters from 7 hospitals from April 20, 2018, to March 17, 2021. A recurrent neural network (RNN) was trained using data from 5 hospitals, and external validation was conducted on data from 2 hospitals. In addition to ARDS, 12 target labels for related conditions such as sepsis, hypoxemia, and COVID-19 were used to train the model to classify a total of 13 outputs. As a comparator, XGBoost models were developed for each of the 13 target labels. Model performance was assessed using the area under the receiver operating characteristic curve. Heat maps to visualize attention scores were generated to provide interpretability to the neural networks. Finally, cluster analysis was performed to identify potential phenotypic subgroups of patients with ARDS. RESULTS: The single RNN model trained to classify 13 outputs outperformed the individual XGBoost models for ARDS prediction, achieving an area under the receiver operating characteristic curve of 0.842 on the external test sets. Models trained on an increasing number of tasks resulted in improved performance. Earlier prediction of ARDS nearly doubled the rate of in-hospital survival. Cluster analysis revealed distinct ARDS subgroups, some of which had similar mortality rates but different clinical presentations. CONCLUSIONS: The RNN model presented in this paper can be used as an early warning system to stratify patients who are at risk of developing one of the multiple risk outcomes, hence providing practitioners with the means to take early action. JMIR Publications 2022-06-15 /pmc/articles/PMC9244659/ /pubmed/35704370 http://dx.doi.org/10.2196/36202 Text en ©Carson Lam, Rahul Thapa, Jenish Maharjan, Keyvan Rahmani, Chak Foon Tso, Navan Preet Singh, Satish Casie Chetty, Qingqing Mao. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 15.06.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Lam, Carson Thapa, Rahul Maharjan, Jenish Rahmani, Keyvan Tso, Chak Foon Singh, Navan Preet Casie Chetty, Satish Mao, Qingqing Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study |
title | Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study |
title_full | Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study |
title_fullStr | Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study |
title_full_unstemmed | Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study |
title_short | Multitask Learning With Recurrent Neural Networks for Acute Respiratory Distress Syndrome Prediction Using Only Electronic Health Record Data: Model Development and Validation Study |
title_sort | multitask learning with recurrent neural networks for acute respiratory distress syndrome prediction using only electronic health record data: model development and validation study |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9244659/ https://www.ncbi.nlm.nih.gov/pubmed/35704370 http://dx.doi.org/10.2196/36202 |
work_keys_str_mv | AT lamcarson multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy AT thaparahul multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy AT maharjanjenish multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy AT rahmanikeyvan multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy AT tsochakfoon multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy AT singhnavanpreet multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy AT casiechettysatish multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy AT maoqingqing multitasklearningwithrecurrentneuralnetworksforacuterespiratorydistresssyndromepredictionusingonlyelectronichealthrecorddatamodeldevelopmentandvalidationstudy |