Cargando…
Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study
BACKGROUND: A high number of patients who are hospitalized with COVID-19 develop acute respiratory distress syndrome (ARDS). OBJECTIVE: In response to the need for clinical decision support tools to help manage the next pandemic during the early stages (ie, when limited labeled data are present), we...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8447921/ https://www.ncbi.nlm.nih.gov/pubmed/34398784 http://dx.doi.org/10.2196/28028 |
_version_ | 1784569120148160512 |
---|---|
author | Lam, Carson Tso, Chak Foon Green-Saxena, Abigail Pellegrini, Emily Iqbal, Zohora Evans, Daniel Hoffman, Jana Calvert, Jacob Mao, Qingqing Das, Ritankar |
author_facet | Lam, Carson Tso, Chak Foon Green-Saxena, Abigail Pellegrini, Emily Iqbal, Zohora Evans, Daniel Hoffman, Jana Calvert, Jacob Mao, Qingqing Das, Ritankar |
author_sort | Lam, Carson |
collection | PubMed |
description | BACKGROUND: A high number of patients who are hospitalized with COVID-19 develop acute respiratory distress syndrome (ARDS). OBJECTIVE: In response to the need for clinical decision support tools to help manage the next pandemic during the early stages (ie, when limited labeled data are present), we developed machine learning algorithms that use semisupervised learning (SSL) techniques to predict ARDS development in general and COVID-19 populations based on limited labeled data. METHODS: SSL techniques were applied to 29,127 encounters with patients who were admitted to 7 US hospitals from May 1, 2019, to May 1, 2021. A recurrent neural network that used a time series of electronic health record data was applied to data that were collected when a patient’s peripheral oxygen saturation level fell below the normal range (<97%) to predict the subsequent development of ARDS during the remaining duration of patients’ hospital stay. Model performance was assessed with the area under the receiver operating characteristic curve and area under the precision recall curve of an external hold-out test set. RESULTS: For the whole data set, the median time between the first peripheral oxygen saturation measurement of <97% and subsequent respiratory failure was 21 hours. The area under the receiver operating characteristic curve for predicting subsequent ARDS development was 0.73 when the model was trained on a labeled data set of 6930 patients, 0.78 when the model was trained on the labeled data set that had been augmented with the unlabeled data set of 16,173 patients by using SSL techniques, and 0.84 when the model was trained on the entire training set of 23,103 labeled patients. CONCLUSIONS: In the context of using time-series inpatient data and a careful model training design, unlabeled data can be used to improve the performance of machine learning models when labeled data for predicting ARDS development are scarce or expensive. |
format | Online Article Text |
id | pubmed-8447921 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-84479212021-10-06 Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study Lam, Carson Tso, Chak Foon Green-Saxena, Abigail Pellegrini, Emily Iqbal, Zohora Evans, Daniel Hoffman, Jana Calvert, Jacob Mao, Qingqing Das, Ritankar JMIR Form Res Original Paper BACKGROUND: A high number of patients who are hospitalized with COVID-19 develop acute respiratory distress syndrome (ARDS). OBJECTIVE: In response to the need for clinical decision support tools to help manage the next pandemic during the early stages (ie, when limited labeled data are present), we developed machine learning algorithms that use semisupervised learning (SSL) techniques to predict ARDS development in general and COVID-19 populations based on limited labeled data. METHODS: SSL techniques were applied to 29,127 encounters with patients who were admitted to 7 US hospitals from May 1, 2019, to May 1, 2021. A recurrent neural network that used a time series of electronic health record data was applied to data that were collected when a patient’s peripheral oxygen saturation level fell below the normal range (<97%) to predict the subsequent development of ARDS during the remaining duration of patients’ hospital stay. Model performance was assessed with the area under the receiver operating characteristic curve and area under the precision recall curve of an external hold-out test set. RESULTS: For the whole data set, the median time between the first peripheral oxygen saturation measurement of <97% and subsequent respiratory failure was 21 hours. The area under the receiver operating characteristic curve for predicting subsequent ARDS development was 0.73 when the model was trained on a labeled data set of 6930 patients, 0.78 when the model was trained on the labeled data set that had been augmented with the unlabeled data set of 16,173 patients by using SSL techniques, and 0.84 when the model was trained on the entire training set of 23,103 labeled patients. CONCLUSIONS: In the context of using time-series inpatient data and a careful model training design, unlabeled data can be used to improve the performance of machine learning models when labeled data for predicting ARDS development are scarce or expensive. JMIR Publications 2021-09-14 /pmc/articles/PMC8447921/ /pubmed/34398784 http://dx.doi.org/10.2196/28028 Text en ©Carson Lam, Chak Foon Tso, Abigail Green-Saxena, Emily Pellegrini, Zohora Iqbal, Daniel Evans, Jana Hoffman, Jacob Calvert, Qingqing Mao, Ritankar Das. Originally published in JMIR Formative Research (https://formative.jmir.org), 14.09.2021. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Lam, Carson Tso, Chak Foon Green-Saxena, Abigail Pellegrini, Emily Iqbal, Zohora Evans, Daniel Hoffman, Jana Calvert, Jacob Mao, Qingqing Das, Ritankar Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study |
title | Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study |
title_full | Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study |
title_fullStr | Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study |
title_full_unstemmed | Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study |
title_short | Semisupervised Deep Learning Techniques for Predicting Acute Respiratory Distress Syndrome From Time-Series Clinical Data: Model Development and Validation Study |
title_sort | semisupervised deep learning techniques for predicting acute respiratory distress syndrome from time-series clinical data: model development and validation study |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8447921/ https://www.ncbi.nlm.nih.gov/pubmed/34398784 http://dx.doi.org/10.2196/28028 |
work_keys_str_mv | AT lamcarson semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT tsochakfoon semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT greensaxenaabigail semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT pellegriniemily semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT iqbalzohora semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT evansdaniel semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT hoffmanjana semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT calvertjacob semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT maoqingqing semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy AT dasritankar semisuperviseddeeplearningtechniquesforpredictingacuterespiratorydistresssyndromefromtimeseriesclinicaldatamodeldevelopmentandvalidationstudy |