Cargando…

Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations

To evaluate the reader’s diagnostic performance against the ground truth with and without the help of a novel content-based image retrieval system (CBIR) that retrieves images with similar CT patterns from a database of 79 different interstitial lung diseases. We evaluated three novice readers’ and...

Descripción completa

Detalles Bibliográficos
Autores principales: Pogarell, Tobias, Bayerl, Nadine, Wetzl, Matthias, Roth, Jan-Peter, Speier, Christoph, Cavallaro, Alexander, Uder, Michael, Dankerl, Peter
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8624384/
https://www.ncbi.nlm.nih.gov/pubmed/34829461
http://dx.doi.org/10.3390/diagnostics11112114
_version_ 1784606160993648640
author Pogarell, Tobias
Bayerl, Nadine
Wetzl, Matthias
Roth, Jan-Peter
Speier, Christoph
Cavallaro, Alexander
Uder, Michael
Dankerl, Peter
author_facet Pogarell, Tobias
Bayerl, Nadine
Wetzl, Matthias
Roth, Jan-Peter
Speier, Christoph
Cavallaro, Alexander
Uder, Michael
Dankerl, Peter
author_sort Pogarell, Tobias
collection PubMed
description To evaluate the reader’s diagnostic performance against the ground truth with and without the help of a novel content-based image retrieval system (CBIR) that retrieves images with similar CT patterns from a database of 79 different interstitial lung diseases. We evaluated three novice readers’ and three resident physicians‘ (with at least three years of experience) diagnostic performance evaluating 50 different CTs featuring 10 different patterns (e.g., honeycombing, tree-in bud, ground glass, bronchiectasis, etc.) and 24 different diseases (sarcoidosis, UIP, NSIP, Aspergillosis, COVID-19 pneumonia etc.). The participants read the cases first without assistance (and without feedback regarding correctness), and with a 2-month interval in a random order with the assistance of the novel CBIR. To invoke the CBIR, a ROI is placed into the pathologic pattern by the reader and the system retrieves diseases with similar patterns. To further narrow the differential diagnosis, the readers can consult an integrated textbook and have the possibility of selecting high-level semantic features representing clinical information (chronic, infectious, smoking status, etc.). We analyzed readers’ accuracy without and with CBIR assistance and further tested the hypothesis that the CBIR would help to improve diagnostic performance utilizing Wilcoxon signed rank test. The novice readers demonstrated an unassisted accuracy of 18/28/44%, and an assisted accuracy of 84/82/90%, respectively. The resident physicians demonstrated an unassisted accuracy of 56/56/70%, and an assisted accuracy of 94/90/96%, respectively. For each reader, as well as overall, Sign test demonstrated statistically significant (p < 0.01) difference between the unassisted and the assisted reads. For students and physicians, Chi²-test and Mann-Whitney-U test demonstrated statistically significant (p < 0.01) difference for unassisted reads and statistically insignificant (p > 0.01) difference for assisted reads. The evaluated CBIR relying on pattern analysis and featuring the option to filter the results of the CBIR by predominant characteristics of the diseases via selecting high-level semantic features helped to drastically improve novices’ and resident physicians’ accuracy in diagnosing interstitial lung diseases in CT.
format Online
Article
Text
id pubmed-8624384
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-86243842021-11-27 Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations Pogarell, Tobias Bayerl, Nadine Wetzl, Matthias Roth, Jan-Peter Speier, Christoph Cavallaro, Alexander Uder, Michael Dankerl, Peter Diagnostics (Basel) Article To evaluate the reader’s diagnostic performance against the ground truth with and without the help of a novel content-based image retrieval system (CBIR) that retrieves images with similar CT patterns from a database of 79 different interstitial lung diseases. We evaluated three novice readers’ and three resident physicians‘ (with at least three years of experience) diagnostic performance evaluating 50 different CTs featuring 10 different patterns (e.g., honeycombing, tree-in bud, ground glass, bronchiectasis, etc.) and 24 different diseases (sarcoidosis, UIP, NSIP, Aspergillosis, COVID-19 pneumonia etc.). The participants read the cases first without assistance (and without feedback regarding correctness), and with a 2-month interval in a random order with the assistance of the novel CBIR. To invoke the CBIR, a ROI is placed into the pathologic pattern by the reader and the system retrieves diseases with similar patterns. To further narrow the differential diagnosis, the readers can consult an integrated textbook and have the possibility of selecting high-level semantic features representing clinical information (chronic, infectious, smoking status, etc.). We analyzed readers’ accuracy without and with CBIR assistance and further tested the hypothesis that the CBIR would help to improve diagnostic performance utilizing Wilcoxon signed rank test. The novice readers demonstrated an unassisted accuracy of 18/28/44%, and an assisted accuracy of 84/82/90%, respectively. The resident physicians demonstrated an unassisted accuracy of 56/56/70%, and an assisted accuracy of 94/90/96%, respectively. For each reader, as well as overall, Sign test demonstrated statistically significant (p < 0.01) difference between the unassisted and the assisted reads. For students and physicians, Chi²-test and Mann-Whitney-U test demonstrated statistically significant (p < 0.01) difference for unassisted reads and statistically insignificant (p > 0.01) difference for assisted reads. The evaluated CBIR relying on pattern analysis and featuring the option to filter the results of the CBIR by predominant characteristics of the diseases via selecting high-level semantic features helped to drastically improve novices’ and resident physicians’ accuracy in diagnosing interstitial lung diseases in CT. MDPI 2021-11-15 /pmc/articles/PMC8624384/ /pubmed/34829461 http://dx.doi.org/10.3390/diagnostics11112114 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Pogarell, Tobias
Bayerl, Nadine
Wetzl, Matthias
Roth, Jan-Peter
Speier, Christoph
Cavallaro, Alexander
Uder, Michael
Dankerl, Peter
Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations
title Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations
title_full Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations
title_fullStr Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations
title_full_unstemmed Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations
title_short Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations
title_sort evaluation of a novel content-based image retrieval system for the differentiation of interstitial lung diseases in ct examinations
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8624384/
https://www.ncbi.nlm.nih.gov/pubmed/34829461
http://dx.doi.org/10.3390/diagnostics11112114
work_keys_str_mv AT pogarelltobias evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations
AT bayerlnadine evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations
AT wetzlmatthias evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations
AT rothjanpeter evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations
AT speierchristoph evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations
AT cavallaroalexander evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations
AT udermichael evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations
AT dankerlpeter evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations