Cargando…
Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays
Deep learning (DL) methods have demonstrated superior performance in medical image segmentation tasks. However, selecting a loss function that conforms to the data characteristics is critical for optimal performance. Further, the direct use of traditional DL models does not provide a measure of unce...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9220007/ https://www.ncbi.nlm.nih.gov/pubmed/35740345 http://dx.doi.org/10.3390/biomedicines10061323 |
_version_ | 1784732264434761728 |
---|---|
author | Rajaraman, Sivaramakrishnan Zamzmi, Ghada Yang, Feng Xue, Zhiyun Jaeger, Stefan Antani, Sameer K. |
author_facet | Rajaraman, Sivaramakrishnan Zamzmi, Ghada Yang, Feng Xue, Zhiyun Jaeger, Stefan Antani, Sameer K. |
author_sort | Rajaraman, Sivaramakrishnan |
collection | PubMed |
description | Deep learning (DL) methods have demonstrated superior performance in medical image segmentation tasks. However, selecting a loss function that conforms to the data characteristics is critical for optimal performance. Further, the direct use of traditional DL models does not provide a measure of uncertainty in predictions. Even high-quality automated predictions for medical diagnostic applications demand uncertainty quantification to gain user trust. In this study, we aim to investigate the benefits of (i) selecting an appropriate loss function and (ii) quantifying uncertainty in predictions using a VGG16-based-U-Net model with the Monto–Carlo (MCD) Dropout method for segmenting Tuberculosis (TB)-consistent findings in frontal chest X-rays (CXRs). We determine an optimal uncertainty threshold based on several uncertainty-related metrics. This threshold is used to select and refer highly uncertain cases to an expert. Experimental results demonstrate that (i) the model trained with a modified Focal Tversky loss function delivered superior segmentation performance (mean average precision (mAP): 0.5710, 95% confidence interval (CI): (0.4021,0.7399)), (ii) the model with 30 MC forward passes during inference further improved and stabilized performance (mAP: 0.5721, 95% CI: (0.4032,0.7410), and (iii) an uncertainty threshold of 0.7 is observed to be optimal to refer highly uncertain cases. |
format | Online Article Text |
id | pubmed-9220007 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-92200072022-06-24 Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays Rajaraman, Sivaramakrishnan Zamzmi, Ghada Yang, Feng Xue, Zhiyun Jaeger, Stefan Antani, Sameer K. Biomedicines Article Deep learning (DL) methods have demonstrated superior performance in medical image segmentation tasks. However, selecting a loss function that conforms to the data characteristics is critical for optimal performance. Further, the direct use of traditional DL models does not provide a measure of uncertainty in predictions. Even high-quality automated predictions for medical diagnostic applications demand uncertainty quantification to gain user trust. In this study, we aim to investigate the benefits of (i) selecting an appropriate loss function and (ii) quantifying uncertainty in predictions using a VGG16-based-U-Net model with the Monto–Carlo (MCD) Dropout method for segmenting Tuberculosis (TB)-consistent findings in frontal chest X-rays (CXRs). We determine an optimal uncertainty threshold based on several uncertainty-related metrics. This threshold is used to select and refer highly uncertain cases to an expert. Experimental results demonstrate that (i) the model trained with a modified Focal Tversky loss function delivered superior segmentation performance (mean average precision (mAP): 0.5710, 95% confidence interval (CI): (0.4021,0.7399)), (ii) the model with 30 MC forward passes during inference further improved and stabilized performance (mAP: 0.5721, 95% CI: (0.4032,0.7410), and (iii) an uncertainty threshold of 0.7 is observed to be optimal to refer highly uncertain cases. MDPI 2022-06-04 /pmc/articles/PMC9220007/ /pubmed/35740345 http://dx.doi.org/10.3390/biomedicines10061323 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Rajaraman, Sivaramakrishnan Zamzmi, Ghada Yang, Feng Xue, Zhiyun Jaeger, Stefan Antani, Sameer K. Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays |
title | Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays |
title_full | Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays |
title_fullStr | Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays |
title_full_unstemmed | Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays |
title_short | Uncertainty Quantification in Segmenting Tuberculosis-Consistent Findings in Frontal Chest X-rays |
title_sort | uncertainty quantification in segmenting tuberculosis-consistent findings in frontal chest x-rays |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9220007/ https://www.ncbi.nlm.nih.gov/pubmed/35740345 http://dx.doi.org/10.3390/biomedicines10061323 |
work_keys_str_mv | AT rajaramansivaramakrishnan uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays AT zamzmighada uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays AT yangfeng uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays AT xuezhiyun uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays AT jaegerstefan uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays AT antanisameerk uncertaintyquantificationinsegmentingtuberculosisconsistentfindingsinfrontalchestxrays |