Cargando…

Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph

Image-based teleconsultation using smartphones has become increasingly popular. In parallel, deep learning algorithms have been developed to detect radiological findings in chest X-rays (CXRs). However, the feasibility of using smartphones to automate this process has yet to be evaluated. This study...

Descripción completa

Detalles Bibliográficos
Autores principales: Kuo, Po-Chih, Tsai, Cheng Che, López, Diego M., Karargyris, Alexandros, Pollard, Tom J., Johnson, Alistair E. W., Celi, Leo Anthony
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7884693/
https://www.ncbi.nlm.nih.gov/pubmed/33589700
http://dx.doi.org/10.1038/s41746-021-00393-9
_version_ 1783651462955401216
author Kuo, Po-Chih
Tsai, Cheng Che
López, Diego M.
Karargyris, Alexandros
Pollard, Tom J.
Johnson, Alistair E. W.
Celi, Leo Anthony
author_facet Kuo, Po-Chih
Tsai, Cheng Che
López, Diego M.
Karargyris, Alexandros
Pollard, Tom J.
Johnson, Alistair E. W.
Celi, Leo Anthony
author_sort Kuo, Po-Chih
collection PubMed
description Image-based teleconsultation using smartphones has become increasingly popular. In parallel, deep learning algorithms have been developed to detect radiological findings in chest X-rays (CXRs). However, the feasibility of using smartphones to automate this process has yet to be evaluated. This study developed a recalibration method to build deep learning models to detect radiological findings on CXR photographs. Two publicly available databases (MIMIC-CXR and CheXpert) were used to build the models, and four derivative datasets containing 6453 CXR photographs were collected to evaluate model performance. After recalibration, the model achieved areas under the receiver operating characteristic curve of 0.80 (95% confidence interval: 0.78–0.82), 0.88 (0.86–0.90), 0.81 (0.79–0.84), 0.79 (0.77–0.81), 0.84 (0.80–0.88), and 0.90 (0.88–0.92), respectively, for detecting cardiomegaly, edema, consolidation, atelectasis, pneumothorax, and pleural effusion. The recalibration strategy, respectively, recovered 84.9%, 83.5%, 53.2%, 57.8%, 69.9%, and 83.0% of performance losses of the uncalibrated model. We conclude that the recalibration method can transfer models from digital CXRs to CXR photographs, which is expected to help physicians’ clinical works.
format Online
Article
Text
id pubmed-7884693
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-78846932021-02-25 Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph Kuo, Po-Chih Tsai, Cheng Che López, Diego M. Karargyris, Alexandros Pollard, Tom J. Johnson, Alistair E. W. Celi, Leo Anthony NPJ Digit Med Article Image-based teleconsultation using smartphones has become increasingly popular. In parallel, deep learning algorithms have been developed to detect radiological findings in chest X-rays (CXRs). However, the feasibility of using smartphones to automate this process has yet to be evaluated. This study developed a recalibration method to build deep learning models to detect radiological findings on CXR photographs. Two publicly available databases (MIMIC-CXR and CheXpert) were used to build the models, and four derivative datasets containing 6453 CXR photographs were collected to evaluate model performance. After recalibration, the model achieved areas under the receiver operating characteristic curve of 0.80 (95% confidence interval: 0.78–0.82), 0.88 (0.86–0.90), 0.81 (0.79–0.84), 0.79 (0.77–0.81), 0.84 (0.80–0.88), and 0.90 (0.88–0.92), respectively, for detecting cardiomegaly, edema, consolidation, atelectasis, pneumothorax, and pleural effusion. The recalibration strategy, respectively, recovered 84.9%, 83.5%, 53.2%, 57.8%, 69.9%, and 83.0% of performance losses of the uncalibrated model. We conclude that the recalibration method can transfer models from digital CXRs to CXR photographs, which is expected to help physicians’ clinical works. Nature Publishing Group UK 2021-02-15 /pmc/articles/PMC7884693/ /pubmed/33589700 http://dx.doi.org/10.1038/s41746-021-00393-9 Text en © The Author(s) 2021 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Kuo, Po-Chih
Tsai, Cheng Che
López, Diego M.
Karargyris, Alexandros
Pollard, Tom J.
Johnson, Alistair E. W.
Celi, Leo Anthony
Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
title Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
title_full Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
title_fullStr Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
title_full_unstemmed Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
title_short Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
title_sort recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7884693/
https://www.ncbi.nlm.nih.gov/pubmed/33589700
http://dx.doi.org/10.1038/s41746-021-00393-9
work_keys_str_mv AT kuopochih recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph
AT tsaichengche recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph
AT lopezdiegom recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph
AT karargyrisalexandros recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph
AT pollardtomj recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph
AT johnsonalistairew recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph
AT celileoanthony recalibrationofdeeplearningmodelsforabnormalitydetectioninsmartphonecapturedchestradiograph