Cargando…

Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study

OBJECTIVES: Digital breast tomosynthesis (DBT) increases sensitivity of mammography and is increasingly implemented in breast cancer screening. However, the large volume of images increases the risk of reading errors and reading time. This study aims to investigate whether the accuracy of breast rad...

Descripción completa

Detalles Bibliográficos
Autores principales: van Winkel, Suzanne L., Rodríguez-Ruiz, Alejandro, Appelman, Linda, Gubern-Mérida, Albert, Karssemeijer, Nico, Teuwen, Jonas, Wanders, Alexander J. T., Sechopoulos, Ioannis, Mann, Ritse M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8523448/
https://www.ncbi.nlm.nih.gov/pubmed/33948701
http://dx.doi.org/10.1007/s00330-021-07992-w
_version_ 1784585302529015808
author van Winkel, Suzanne L.
Rodríguez-Ruiz, Alejandro
Appelman, Linda
Gubern-Mérida, Albert
Karssemeijer, Nico
Teuwen, Jonas
Wanders, Alexander J. T.
Sechopoulos, Ioannis
Mann, Ritse M.
author_facet van Winkel, Suzanne L.
Rodríguez-Ruiz, Alejandro
Appelman, Linda
Gubern-Mérida, Albert
Karssemeijer, Nico
Teuwen, Jonas
Wanders, Alexander J. T.
Sechopoulos, Ioannis
Mann, Ritse M.
author_sort van Winkel, Suzanne L.
collection PubMed
description OBJECTIVES: Digital breast tomosynthesis (DBT) increases sensitivity of mammography and is increasingly implemented in breast cancer screening. However, the large volume of images increases the risk of reading errors and reading time. This study aims to investigate whether the accuracy of breast radiologists reading wide-angle DBT increases with the aid of an artificial intelligence (AI) support system. Also, the impact on reading time was assessed and the stand-alone performance of the AI system in the detection of malignancies was compared to the average radiologist. METHODS: A multi-reader multi-case study was performed with 240 bilateral DBT exams (71 breasts with cancer lesions, 70 breasts with benign findings, 339 normal breasts). Exams were interpreted by 18 radiologists, with and without AI support, providing cancer suspicion scores per breast. Using AI support, radiologists were shown examination-based and region-based cancer likelihood scores. Area under the receiver operating characteristic curve (AUC) and reading time per exam were compared between reading conditions using mixed-models analysis of variance. RESULTS: On average, the AUC was higher using AI support (0.863 vs 0.833; p = 0.0025). Using AI support, reading time per DBT exam was reduced (p < 0.001) from 41 (95% CI = 39–42 s) to 36 s (95% CI = 35– 37 s). The AUC of the stand-alone AI system was non-inferior to the AUC of the average radiologist (+0.007, p = 0.8115). CONCLUSIONS: Radiologists improved their cancer detection and reduced reading time when evaluating DBT examinations using an AI reading support system. KEY POINTS: • Radiologists improved their cancer detection accuracy in digital breast tomosynthesis (DBT) when using an AI system for support, while simultaneously reducing reading time. • The stand-alone breast cancer detection performance of an AI system is non-inferior to the average performance of radiologists for reading digital breast tomosynthesis exams. • The use of an AI support system could make advanced and more reliable imaging techniques more accessible and could allow for more cost-effective breast screening programs with DBT.
format Online
Article
Text
id pubmed-8523448
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-85234482021-10-22 Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study van Winkel, Suzanne L. Rodríguez-Ruiz, Alejandro Appelman, Linda Gubern-Mérida, Albert Karssemeijer, Nico Teuwen, Jonas Wanders, Alexander J. T. Sechopoulos, Ioannis Mann, Ritse M. Eur Radiol Breast OBJECTIVES: Digital breast tomosynthesis (DBT) increases sensitivity of mammography and is increasingly implemented in breast cancer screening. However, the large volume of images increases the risk of reading errors and reading time. This study aims to investigate whether the accuracy of breast radiologists reading wide-angle DBT increases with the aid of an artificial intelligence (AI) support system. Also, the impact on reading time was assessed and the stand-alone performance of the AI system in the detection of malignancies was compared to the average radiologist. METHODS: A multi-reader multi-case study was performed with 240 bilateral DBT exams (71 breasts with cancer lesions, 70 breasts with benign findings, 339 normal breasts). Exams were interpreted by 18 radiologists, with and without AI support, providing cancer suspicion scores per breast. Using AI support, radiologists were shown examination-based and region-based cancer likelihood scores. Area under the receiver operating characteristic curve (AUC) and reading time per exam were compared between reading conditions using mixed-models analysis of variance. RESULTS: On average, the AUC was higher using AI support (0.863 vs 0.833; p = 0.0025). Using AI support, reading time per DBT exam was reduced (p < 0.001) from 41 (95% CI = 39–42 s) to 36 s (95% CI = 35– 37 s). The AUC of the stand-alone AI system was non-inferior to the AUC of the average radiologist (+0.007, p = 0.8115). CONCLUSIONS: Radiologists improved their cancer detection and reduced reading time when evaluating DBT examinations using an AI reading support system. KEY POINTS: • Radiologists improved their cancer detection accuracy in digital breast tomosynthesis (DBT) when using an AI system for support, while simultaneously reducing reading time. • The stand-alone breast cancer detection performance of an AI system is non-inferior to the average performance of radiologists for reading digital breast tomosynthesis exams. • The use of an AI support system could make advanced and more reliable imaging techniques more accessible and could allow for more cost-effective breast screening programs with DBT. Springer Berlin Heidelberg 2021-05-04 2021 /pmc/articles/PMC8523448/ /pubmed/33948701 http://dx.doi.org/10.1007/s00330-021-07992-w Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Breast
van Winkel, Suzanne L.
Rodríguez-Ruiz, Alejandro
Appelman, Linda
Gubern-Mérida, Albert
Karssemeijer, Nico
Teuwen, Jonas
Wanders, Alexander J. T.
Sechopoulos, Ioannis
Mann, Ritse M.
Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
title Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
title_full Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
title_fullStr Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
title_full_unstemmed Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
title_short Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
title_sort impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
topic Breast
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8523448/
https://www.ncbi.nlm.nih.gov/pubmed/33948701
http://dx.doi.org/10.1007/s00330-021-07992-w
work_keys_str_mv AT vanwinkelsuzannel impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT rodriguezruizalejandro impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT appelmanlinda impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT gubernmeridaalbert impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT karssemeijernico impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT teuwenjonas impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT wandersalexanderjt impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT sechopoulosioannis impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy
AT mannritsem impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy