Cargando…
Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations
To evaluate the reader’s diagnostic performance against the ground truth with and without the help of a novel content-based image retrieval system (CBIR) that retrieves images with similar CT patterns from a database of 79 different interstitial lung diseases. We evaluated three novice readers’ and...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8624384/ https://www.ncbi.nlm.nih.gov/pubmed/34829461 http://dx.doi.org/10.3390/diagnostics11112114 |
_version_ | 1784606160993648640 |
---|---|
author | Pogarell, Tobias Bayerl, Nadine Wetzl, Matthias Roth, Jan-Peter Speier, Christoph Cavallaro, Alexander Uder, Michael Dankerl, Peter |
author_facet | Pogarell, Tobias Bayerl, Nadine Wetzl, Matthias Roth, Jan-Peter Speier, Christoph Cavallaro, Alexander Uder, Michael Dankerl, Peter |
author_sort | Pogarell, Tobias |
collection | PubMed |
description | To evaluate the reader’s diagnostic performance against the ground truth with and without the help of a novel content-based image retrieval system (CBIR) that retrieves images with similar CT patterns from a database of 79 different interstitial lung diseases. We evaluated three novice readers’ and three resident physicians‘ (with at least three years of experience) diagnostic performance evaluating 50 different CTs featuring 10 different patterns (e.g., honeycombing, tree-in bud, ground glass, bronchiectasis, etc.) and 24 different diseases (sarcoidosis, UIP, NSIP, Aspergillosis, COVID-19 pneumonia etc.). The participants read the cases first without assistance (and without feedback regarding correctness), and with a 2-month interval in a random order with the assistance of the novel CBIR. To invoke the CBIR, a ROI is placed into the pathologic pattern by the reader and the system retrieves diseases with similar patterns. To further narrow the differential diagnosis, the readers can consult an integrated textbook and have the possibility of selecting high-level semantic features representing clinical information (chronic, infectious, smoking status, etc.). We analyzed readers’ accuracy without and with CBIR assistance and further tested the hypothesis that the CBIR would help to improve diagnostic performance utilizing Wilcoxon signed rank test. The novice readers demonstrated an unassisted accuracy of 18/28/44%, and an assisted accuracy of 84/82/90%, respectively. The resident physicians demonstrated an unassisted accuracy of 56/56/70%, and an assisted accuracy of 94/90/96%, respectively. For each reader, as well as overall, Sign test demonstrated statistically significant (p < 0.01) difference between the unassisted and the assisted reads. For students and physicians, Chi²-test and Mann-Whitney-U test demonstrated statistically significant (p < 0.01) difference for unassisted reads and statistically insignificant (p > 0.01) difference for assisted reads. The evaluated CBIR relying on pattern analysis and featuring the option to filter the results of the CBIR by predominant characteristics of the diseases via selecting high-level semantic features helped to drastically improve novices’ and resident physicians’ accuracy in diagnosing interstitial lung diseases in CT. |
format | Online Article Text |
id | pubmed-8624384 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-86243842021-11-27 Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations Pogarell, Tobias Bayerl, Nadine Wetzl, Matthias Roth, Jan-Peter Speier, Christoph Cavallaro, Alexander Uder, Michael Dankerl, Peter Diagnostics (Basel) Article To evaluate the reader’s diagnostic performance against the ground truth with and without the help of a novel content-based image retrieval system (CBIR) that retrieves images with similar CT patterns from a database of 79 different interstitial lung diseases. We evaluated three novice readers’ and three resident physicians‘ (with at least three years of experience) diagnostic performance evaluating 50 different CTs featuring 10 different patterns (e.g., honeycombing, tree-in bud, ground glass, bronchiectasis, etc.) and 24 different diseases (sarcoidosis, UIP, NSIP, Aspergillosis, COVID-19 pneumonia etc.). The participants read the cases first without assistance (and without feedback regarding correctness), and with a 2-month interval in a random order with the assistance of the novel CBIR. To invoke the CBIR, a ROI is placed into the pathologic pattern by the reader and the system retrieves diseases with similar patterns. To further narrow the differential diagnosis, the readers can consult an integrated textbook and have the possibility of selecting high-level semantic features representing clinical information (chronic, infectious, smoking status, etc.). We analyzed readers’ accuracy without and with CBIR assistance and further tested the hypothesis that the CBIR would help to improve diagnostic performance utilizing Wilcoxon signed rank test. The novice readers demonstrated an unassisted accuracy of 18/28/44%, and an assisted accuracy of 84/82/90%, respectively. The resident physicians demonstrated an unassisted accuracy of 56/56/70%, and an assisted accuracy of 94/90/96%, respectively. For each reader, as well as overall, Sign test demonstrated statistically significant (p < 0.01) difference between the unassisted and the assisted reads. For students and physicians, Chi²-test and Mann-Whitney-U test demonstrated statistically significant (p < 0.01) difference for unassisted reads and statistically insignificant (p > 0.01) difference for assisted reads. The evaluated CBIR relying on pattern analysis and featuring the option to filter the results of the CBIR by predominant characteristics of the diseases via selecting high-level semantic features helped to drastically improve novices’ and resident physicians’ accuracy in diagnosing interstitial lung diseases in CT. MDPI 2021-11-15 /pmc/articles/PMC8624384/ /pubmed/34829461 http://dx.doi.org/10.3390/diagnostics11112114 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Pogarell, Tobias Bayerl, Nadine Wetzl, Matthias Roth, Jan-Peter Speier, Christoph Cavallaro, Alexander Uder, Michael Dankerl, Peter Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations |
title | Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations |
title_full | Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations |
title_fullStr | Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations |
title_full_unstemmed | Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations |
title_short | Evaluation of a Novel Content-Based Image Retrieval System for the Differentiation of Interstitial Lung Diseases in CT Examinations |
title_sort | evaluation of a novel content-based image retrieval system for the differentiation of interstitial lung diseases in ct examinations |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8624384/ https://www.ncbi.nlm.nih.gov/pubmed/34829461 http://dx.doi.org/10.3390/diagnostics11112114 |
work_keys_str_mv | AT pogarelltobias evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations AT bayerlnadine evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations AT wetzlmatthias evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations AT rothjanpeter evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations AT speierchristoph evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations AT cavallaroalexander evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations AT udermichael evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations AT dankerlpeter evaluationofanovelcontentbasedimageretrievalsystemforthedifferentiationofinterstitiallungdiseasesinctexaminations |