Cargando…

The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule

BACKGROUND: The deep learning-based nodule detection (DLD) system improves nodule detection performance of observers on chest radiographs (CXRs). However, its performance in different pulmonary nodule (PN) locations remains unknown. METHODS: We divided the CXR intrathoracic region into non-danger zo...

Descripción completa

Detalles Bibliográficos
Autores principales: You, Seulgi, Park, Ji Hyun, Park, Bumhee, Shin, Han-Bit, Ha, Taeyang, Yun, Jae Sung, Park, Kyoung Joo, Jung, Yongjun, Kim, You Na, Kim, Minji, Sun, Joo Sung
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Vienna 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10509107/
https://www.ncbi.nlm.nih.gov/pubmed/37726452
http://dx.doi.org/10.1186/s13244-023-01497-4
_version_ 1785107669725478912
author You, Seulgi
Park, Ji Hyun
Park, Bumhee
Shin, Han-Bit
Ha, Taeyang
Yun, Jae Sung
Park, Kyoung Joo
Jung, Yongjun
Kim, You Na
Kim, Minji
Sun, Joo Sung
author_facet You, Seulgi
Park, Ji Hyun
Park, Bumhee
Shin, Han-Bit
Ha, Taeyang
Yun, Jae Sung
Park, Kyoung Joo
Jung, Yongjun
Kim, You Na
Kim, Minji
Sun, Joo Sung
author_sort You, Seulgi
collection PubMed
description BACKGROUND: The deep learning-based nodule detection (DLD) system improves nodule detection performance of observers on chest radiographs (CXRs). However, its performance in different pulmonary nodule (PN) locations remains unknown. METHODS: We divided the CXR intrathoracic region into non-danger zone (NDZ) and danger zone (DZ). The DZ included the lung apices, paramediastinal areas, and retrodiaphragmatic areas, where nodules could be missed. We used a dataset of 300 CXRs (100 normal and 200 abnormal images with 216 PNs [107 NDZ and 109 DZ nodules]). Eight observers (two thoracic radiologists [TRs], two non-thoracic radiologists [NTRs], and four radiology residents [RRs]) interpreted each radiograph with and without the DLD system. The metric of lesion localization fraction (LLF; the number of correctly localized lesions divided by the total number of true lesions) was used to evaluate the diagnostic performance according to the nodule location. RESULTS: The DLD system demonstrated a lower LLF for the detection of DZ nodules (64.2) than that of NDZ nodules (83.2, p = 0.008). For DZ nodule detection, the LLF of the DLD system (64.2) was lower than that of TRs (81.7, p < 0.001), which was comparable to that of NTRs (56.4, p = 0.531) and RRs (56.7, p = 0.459). Nonetheless, the LLF of RRs significantly improved from 56.7 to 65.6 using the DLD system (p = 0.021) for DZ nodule detection. CONCLUSION: The performance of the DLD system was lower in the detection of DZ nodules compared to that of NDZ nodules. Nonetheless, RR performance in detecting DZ nodules improved upon using the DLD system. CRITICAL RELEVANCE STATEMENT: Despite the deep learning-based nodule detection system’s limitations in detecting danger zone nodules, it proves beneficial for less-experienced observers by providing valuable assistance in identifying these nodules, thereby advancing nodule detection in clinical practice. KEY POINTS: • The deep learning-based nodule detection (DLD) system can improve the diagnostic performance of observers in nodule detection. • The DLD system shows poor diagnostic performance in detecting danger zone nodules. • For less-experienced observers, the DLD system is helpful in detecting danger zone nodules. GRAPHICAL ABSTRACT: [Image: see text] SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13244-023-01497-4.
format Online
Article
Text
id pubmed-10509107
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer Vienna
record_format MEDLINE/PubMed
spelling pubmed-105091072023-09-21 The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule You, Seulgi Park, Ji Hyun Park, Bumhee Shin, Han-Bit Ha, Taeyang Yun, Jae Sung Park, Kyoung Joo Jung, Yongjun Kim, You Na Kim, Minji Sun, Joo Sung Insights Imaging Original Article BACKGROUND: The deep learning-based nodule detection (DLD) system improves nodule detection performance of observers on chest radiographs (CXRs). However, its performance in different pulmonary nodule (PN) locations remains unknown. METHODS: We divided the CXR intrathoracic region into non-danger zone (NDZ) and danger zone (DZ). The DZ included the lung apices, paramediastinal areas, and retrodiaphragmatic areas, where nodules could be missed. We used a dataset of 300 CXRs (100 normal and 200 abnormal images with 216 PNs [107 NDZ and 109 DZ nodules]). Eight observers (two thoracic radiologists [TRs], two non-thoracic radiologists [NTRs], and four radiology residents [RRs]) interpreted each radiograph with and without the DLD system. The metric of lesion localization fraction (LLF; the number of correctly localized lesions divided by the total number of true lesions) was used to evaluate the diagnostic performance according to the nodule location. RESULTS: The DLD system demonstrated a lower LLF for the detection of DZ nodules (64.2) than that of NDZ nodules (83.2, p = 0.008). For DZ nodule detection, the LLF of the DLD system (64.2) was lower than that of TRs (81.7, p < 0.001), which was comparable to that of NTRs (56.4, p = 0.531) and RRs (56.7, p = 0.459). Nonetheless, the LLF of RRs significantly improved from 56.7 to 65.6 using the DLD system (p = 0.021) for DZ nodule detection. CONCLUSION: The performance of the DLD system was lower in the detection of DZ nodules compared to that of NDZ nodules. Nonetheless, RR performance in detecting DZ nodules improved upon using the DLD system. CRITICAL RELEVANCE STATEMENT: Despite the deep learning-based nodule detection system’s limitations in detecting danger zone nodules, it proves beneficial for less-experienced observers by providing valuable assistance in identifying these nodules, thereby advancing nodule detection in clinical practice. KEY POINTS: • The deep learning-based nodule detection (DLD) system can improve the diagnostic performance of observers in nodule detection. • The DLD system shows poor diagnostic performance in detecting danger zone nodules. • For less-experienced observers, the DLD system is helpful in detecting danger zone nodules. GRAPHICAL ABSTRACT: [Image: see text] SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13244-023-01497-4. Springer Vienna 2023-09-19 /pmc/articles/PMC10509107/ /pubmed/37726452 http://dx.doi.org/10.1186/s13244-023-01497-4 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Original Article
You, Seulgi
Park, Ji Hyun
Park, Bumhee
Shin, Han-Bit
Ha, Taeyang
Yun, Jae Sung
Park, Kyoung Joo
Jung, Yongjun
Kim, You Na
Kim, Minji
Sun, Joo Sung
The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule
title The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule
title_full The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule
title_fullStr The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule
title_full_unstemmed The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule
title_short The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule
title_sort diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10509107/
https://www.ncbi.nlm.nih.gov/pubmed/37726452
http://dx.doi.org/10.1186/s13244-023-01497-4
work_keys_str_mv AT youseulgi thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT parkjihyun thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT parkbumhee thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT shinhanbit thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT hataeyang thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT yunjaesung thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT parkkyoungjoo thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT jungyongjun thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT kimyouna thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT kimminji thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT sunjoosung thediagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT youseulgi diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT parkjihyun diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT parkbumhee diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT shinhanbit diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT hataeyang diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT yunjaesung diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT parkkyoungjoo diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT jungyongjun diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT kimyouna diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT kimminji diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule
AT sunjoosung diagnosticperformanceandclinicalvalueofdeeplearningbasednoduledetectionsystemconcerninginfluenceoflocationofpulmonarynodule