Cargando…

Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists

It is unclear whether the visualization methods for artificial-intelligence-based computer-aided detection (AI-CAD) of chest radiographs influence the accuracy of readers’ interpretation. We aimed to evaluate the accuracy of radiologists’ interpretations of chest radiographs using different visualiz...

Descripción completa

Detalles Bibliográficos
Autores principales: Hong, Sungho, Hwang, Eui Jin, Kim, Soojin, Song, Jiyoung, Lee, Taehee, Jo, Gyeong Deok, Choi, Yelim, Park, Chang Min, Goo, Jin Mo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10046978/
https://www.ncbi.nlm.nih.gov/pubmed/36980397
http://dx.doi.org/10.3390/diagnostics13061089
_version_ 1785013807386460160
author Hong, Sungho
Hwang, Eui Jin
Kim, Soojin
Song, Jiyoung
Lee, Taehee
Jo, Gyeong Deok
Choi, Yelim
Park, Chang Min
Goo, Jin Mo
author_facet Hong, Sungho
Hwang, Eui Jin
Kim, Soojin
Song, Jiyoung
Lee, Taehee
Jo, Gyeong Deok
Choi, Yelim
Park, Chang Min
Goo, Jin Mo
author_sort Hong, Sungho
collection PubMed
description It is unclear whether the visualization methods for artificial-intelligence-based computer-aided detection (AI-CAD) of chest radiographs influence the accuracy of readers’ interpretation. We aimed to evaluate the accuracy of radiologists’ interpretations of chest radiographs using different visualization methods for the same AI-CAD. Initial chest radiographs of patients with acute respiratory symptoms were retrospectively collected. A commercialized AI-CAD using three different methods of visualizing was applied: (a) closed-line method, (b) heat map method, and (c) combined method. A reader test was conducted with five trainee radiologists over three interpretation sessions. In each session, the chest radiographs were interpreted using AI-CAD with one of the three visualization methods in random order. Examination-level sensitivity and accuracy, and lesion-level detection rates for clinically significant abnormalities were evaluated for the three visualization methods. The sensitivity (p = 0.007) and accuracy (p = 0.037) of the combined method are significantly higher than that of the closed-line method. Detection rates using the heat map method (p = 0.043) and the combined method (p = 0.004) are significantly higher than those using the closed-line method. The methods for visualizing AI-CAD results for chest radiographs influenced the performance of radiologists’ interpretations. Combining the closed-line and heat map methods for visualizing AI-CAD results led to the highest sensitivity and accuracy of radiologists.
format Online
Article
Text
id pubmed-10046978
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100469782023-03-29 Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists Hong, Sungho Hwang, Eui Jin Kim, Soojin Song, Jiyoung Lee, Taehee Jo, Gyeong Deok Choi, Yelim Park, Chang Min Goo, Jin Mo Diagnostics (Basel) Article It is unclear whether the visualization methods for artificial-intelligence-based computer-aided detection (AI-CAD) of chest radiographs influence the accuracy of readers’ interpretation. We aimed to evaluate the accuracy of radiologists’ interpretations of chest radiographs using different visualization methods for the same AI-CAD. Initial chest radiographs of patients with acute respiratory symptoms were retrospectively collected. A commercialized AI-CAD using three different methods of visualizing was applied: (a) closed-line method, (b) heat map method, and (c) combined method. A reader test was conducted with five trainee radiologists over three interpretation sessions. In each session, the chest radiographs were interpreted using AI-CAD with one of the three visualization methods in random order. Examination-level sensitivity and accuracy, and lesion-level detection rates for clinically significant abnormalities were evaluated for the three visualization methods. The sensitivity (p = 0.007) and accuracy (p = 0.037) of the combined method are significantly higher than that of the closed-line method. Detection rates using the heat map method (p = 0.043) and the combined method (p = 0.004) are significantly higher than those using the closed-line method. The methods for visualizing AI-CAD results for chest radiographs influenced the performance of radiologists’ interpretations. Combining the closed-line and heat map methods for visualizing AI-CAD results led to the highest sensitivity and accuracy of radiologists. MDPI 2023-03-13 /pmc/articles/PMC10046978/ /pubmed/36980397 http://dx.doi.org/10.3390/diagnostics13061089 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Hong, Sungho
Hwang, Eui Jin
Kim, Soojin
Song, Jiyoung
Lee, Taehee
Jo, Gyeong Deok
Choi, Yelim
Park, Chang Min
Goo, Jin Mo
Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists
title Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists
title_full Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists
title_fullStr Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists
title_full_unstemmed Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists
title_short Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists
title_sort methods of visualizing the results of an artificial-intelligence-based computer-aided detection system for chest radiographs: effect on the diagnostic performance of radiologists
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10046978/
https://www.ncbi.nlm.nih.gov/pubmed/36980397
http://dx.doi.org/10.3390/diagnostics13061089
work_keys_str_mv AT hongsungho methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT hwangeuijin methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT kimsoojin methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT songjiyoung methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT leetaehee methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT jogyeongdeok methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT choiyelim methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT parkchangmin methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists
AT goojinmo methodsofvisualizingtheresultsofanartificialintelligencebasedcomputeraideddetectionsystemforchestradiographseffectonthediagnosticperformanceofradiologists