Cargando…

Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays

Deep learning (DL) methods have demonstrated superior performance in medical image segmentation tasks. However, selecting a loss function that conforms to the data characteristics is critical for optimal performance. Further, the direct use of traditional DL models does not provide a measure of unce...

Descripción completa

Detalles Bibliográficos
Autores principales: Rajaraman, Sivaramakrishnan, Zamzmi, Ghada, Yang, Feng, Xue, Zhiyun, Jaeger, Stefan, Antani, Sameer K.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9220007/
https://www.ncbi.nlm.nih.gov/pubmed/35740345
http://dx.doi.org/10.3390/biomedicines10061323
_version_ 1784732264434761728
author Rajaraman, Sivaramakrishnan
Zamzmi, Ghada
Yang, Feng
Xue, Zhiyun
Jaeger, Stefan
Antani, Sameer K.
author_facet Rajaraman, Sivaramakrishnan
Zamzmi, Ghada
Yang, Feng
Xue, Zhiyun
Jaeger, Stefan
Antani, Sameer K.
author_sort Rajaraman, Sivaramakrishnan
collection PubMed
description Deep learning (DL) methods have demonstrated superior performance in medical image segmentation tasks. However, selecting a loss function that conforms to the data characteristics is critical for optimal performance. Further, the direct use of traditional DL models does not provide a measure of uncertainty in predictions. Even high-quality automated predictions for medical diagnostic applications demand uncertainty quantification to gain user trust. In this study, we aim to investigate the benefits of (i) selecting an appropriate loss function and (ii) quantifying uncertainty in predictions using a VGG16-based-U-Net model with the Monto–Carlo (MCD) Dropout method for segmenting Tuberculosis (TB)-consistent findings in frontal chest X-rays (CXRs). We determine an optimal uncertainty threshold based on several uncertainty-related metrics. This threshold is used to select and refer highly uncertain cases to an expert. Experimental results demonstrate that (i) the model trained with a modified Focal Tversky loss function delivered superior segmentation performance (mean average precision (mAP): 0.5710, 95% confidence interval (CI): (0.4021,0.7399)), (ii) the model with 30 MC forward passes during inference further improved and stabilized performance (mAP: 0.5721, 95% CI: (0.4032,0.7410), and (iii) an uncertainty threshold of 0.7 is observed to be optimal to refer highly uncertain cases.
format Online
Article
Text
id pubmed-9220007
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-92200072022-06-24 Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays Rajaraman, Sivaramakrishnan Zamzmi, Ghada Yang, Feng Xue, Zhiyun Jaeger, Stefan Antani, Sameer K. Biomedicines Article Deep learning (DL) methods have demonstrated superior performance in medical image segmentation tasks. However, selecting a loss function that conforms to the data characteristics is critical for optimal performance. Further, the direct use of traditional DL models does not provide a measure of uncertainty in predictions. Even high-quality automated predictions for medical diagnostic applications demand uncertainty quantification to gain user trust. In this study, we aim to investigate the benefits of (i) selecting an appropriate loss function and (ii) quantifying uncertainty in predictions using a VGG16-based-U-Net model with the Monto–Carlo (MCD) Dropout method for segmenting Tuberculosis (TB)-consistent findings in frontal chest X-rays (CXRs). We determine an optimal uncertainty threshold based on several uncertainty-related metrics. This threshold is used to select and refer highly uncertain cases to an expert. Experimental results demonstrate that (i) the model trained with a modified Focal Tversky loss function delivered superior segmentation performance (mean average precision (mAP): 0.5710, 95% confidence interval (CI): (0.4021,0.7399)), (ii) the model with 30 MC forward passes during inference further improved and stabilized performance (mAP: 0.5721, 95% CI: (0.4032,0.7410), and (iii) an uncertainty threshold of 0.7 is observed to be optimal to refer highly uncertain cases. MDPI 2022-06-04 /pmc/articles/PMC9220007/ /pubmed/35740345 http://dx.doi.org/10.3390/biomedicines10061323 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Rajaraman, Sivaramakrishnan
Zamzmi, Ghada
Yang, Feng
Xue, Zhiyun
Jaeger, Stefan
Antani, Sameer K.
Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays
title Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays
title_full Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays
title_fullStr Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays
title_full_unstemmed Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays
title_short Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays
title_sort uncertainty quantification in segmenting tuberculosis-consistent findings in frontal chest x-rays
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9220007/
https://www.ncbi.nlm.nih.gov/pubmed/35740345
http://dx.doi.org/10.3390/biomedicines10061323
work_keys_str_mv AT rajaramansivaramakrishnan uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays
AT zamzmighada uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays
AT yangfeng uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays
AT xuezhiyun uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays
AT jaegerstefan uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays
AT antanisameerk uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays