Cargando…
Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
Image-based teleconsultation using smartphones has become increasingly popular. In parallel, deep learning algorithms have been developed to detect radiological findings in chest X-rays (CXRs). However, the feasibility of using smartphones to automate this process has yet to be evaluated. This study...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7884693/ https://www.ncbi.nlm.nih.gov/pubmed/33589700 http://dx.doi.org/10.1038/s41746-021-00393-9 |
_version_ | 1783651462955401216 |
---|---|
author | Kuo, Po-Chih Tsai, Cheng Che López, Diego M. Karargyris, Alexandros Pollard, Tom J. Johnson, Alistair E. W. Celi, Leo Anthony |
author_facet | Kuo, Po-Chih Tsai, Cheng Che López, Diego M. Karargyris, Alexandros Pollard, Tom J. Johnson, Alistair E. W. Celi, Leo Anthony |
author_sort | Kuo, Po-Chih |
collection | PubMed |
description | Image-based teleconsultation using smartphones has become increasingly popular. In parallel, deep learning algorithms have been developed to detect radiological findings in chest X-rays (CXRs). However, the feasibility of using smartphones to automate this process has yet to be evaluated. This study developed a recalibration method to build deep learning models to detect radiological findings on CXR photographs. Two publicly available databases (MIMIC-CXR and CheXpert) were used to build the models, and four derivative datasets containing 6453 CXR photographs were collected to evaluate model performance. After recalibration, the model achieved areas under the receiver operating characteristic curve of 0.80 (95% confidence interval: 0.78–0.82), 0.88 (0.86–0.90), 0.81 (0.79–0.84), 0.79 (0.77–0.81), 0.84 (0.80–0.88), and 0.90 (0.88–0.92), respectively, for detecting cardiomegaly, edema, consolidation, atelectasis, pneumothorax, and pleural effusion. The recalibration strategy, respectively, recovered 84.9%, 83.5%, 53.2%, 57.8%, 69.9%, and 83.0% of performance losses of the uncalibrated model. We conclude that the recalibration method can transfer models from digital CXRs to CXR photographs, which is expected to help physicians’ clinical works. |
format | Online Article Text |
id | pubmed-7884693 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-78846932021-02-25 Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph Kuo, Po-Chih Tsai, Cheng Che López, Diego M. Karargyris, Alexandros Pollard, Tom J. Johnson, Alistair E. W. Celi, Leo Anthony NPJ Digit Med Article Image-based teleconsultation using smartphones has become increasingly popular. In parallel, deep learning algorithms have been developed to detect radiological findings in chest X-rays (CXRs). However, the feasibility of using smartphones to automate this process has yet to be evaluated. This study developed a recalibration method to build deep learning models to detect radiological findings on CXR photographs. Two publicly available databases (MIMIC-CXR and CheXpert) were used to build the models, and four derivative datasets containing 6453 CXR photographs were collected to evaluate model performance. After recalibration, the model achieved areas under the receiver operating characteristic curve of 0.80 (95% confidence interval: 0.78–0.82), 0.88 (0.86–0.90), 0.81 (0.79–0.84), 0.79 (0.77–0.81), 0.84 (0.80–0.88), and 0.90 (0.88–0.92), respectively, for detecting cardiomegaly, edema, consolidation, atelectasis, pneumothorax, and pleural effusion. The recalibration strategy, respectively, recovered 84.9%, 83.5%, 53.2%, 57.8%, 69.9%, and 83.0% of performance losses of the uncalibrated model. We conclude that the recalibration method can transfer models from digital CXRs to CXR photographs, which is expected to help physicians’ clinical works. Nature Publishing Group UK 2021-02-15 /pmc/articles/PMC7884693/ /pubmed/33589700 http://dx.doi.org/10.1038/s41746-021-00393-9 Text en © The Author(s) 2021 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Kuo, Po-Chih Tsai, Cheng Che López, Diego M. Karargyris, Alexandros Pollard, Tom J. Johnson, Alistair E. W. Celi, Leo Anthony Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph |
title | Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph |
title_full | Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph |
title_fullStr | Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph |
title_full_unstemmed | Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph |
title_short | Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph |
title_sort | recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7884693/ https://www.ncbi.nlm.nih.gov/pubmed/33589700 http://dx.doi.org/10.1038/s41746-021-00393-9 |
work_keys_str_mv | AT kuopochih recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph AT tsaichengche recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph AT lopezdiegom recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph AT karargyrisalexandros recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph AT pollardtomj recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph AT johnsonalistairew recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph AT celileoanthony recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph |