Cargando…
Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study
OBJECTIVES: Digital breast tomosynthesis (DBT) increases sensitivity of mammography and is increasingly implemented in breast cancer screening. However, the large volume of images increases the risk of reading errors and reading time. This study aims to investigate whether the accuracy of breast rad...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8523448/ https://www.ncbi.nlm.nih.gov/pubmed/33948701 http://dx.doi.org/10.1007/s00330-021-07992-w |
_version_ | 1784585302529015808 |
---|---|
author | van Winkel, Suzanne L. Rodríguez-Ruiz, Alejandro Appelman, Linda Gubern-Mérida, Albert Karssemeijer, Nico Teuwen, Jonas Wanders, Alexander J. T. Sechopoulos, Ioannis Mann, Ritse M. |
author_facet | van Winkel, Suzanne L. Rodríguez-Ruiz, Alejandro Appelman, Linda Gubern-Mérida, Albert Karssemeijer, Nico Teuwen, Jonas Wanders, Alexander J. T. Sechopoulos, Ioannis Mann, Ritse M. |
author_sort | van Winkel, Suzanne L. |
collection | PubMed |
description | OBJECTIVES: Digital breast tomosynthesis (DBT) increases sensitivity of mammography and is increasingly implemented in breast cancer screening. However, the large volume of images increases the risk of reading errors and reading time. This study aims to investigate whether the accuracy of breast radiologists reading wide-angle DBT increases with the aid of an artificial intelligence (AI) support system. Also, the impact on reading time was assessed and the stand-alone performance of the AI system in the detection of malignancies was compared to the average radiologist. METHODS: A multi-reader multi-case study was performed with 240 bilateral DBT exams (71 breasts with cancer lesions, 70 breasts with benign findings, 339 normal breasts). Exams were interpreted by 18 radiologists, with and without AI support, providing cancer suspicion scores per breast. Using AI support, radiologists were shown examination-based and region-based cancer likelihood scores. Area under the receiver operating characteristic curve (AUC) and reading time per exam were compared between reading conditions using mixed-models analysis of variance. RESULTS: On average, the AUC was higher using AI support (0.863 vs 0.833; p = 0.0025). Using AI support, reading time per DBT exam was reduced (p < 0.001) from 41 (95% CI = 39–42 s) to 36 s (95% CI = 35– 37 s). The AUC of the stand-alone AI system was non-inferior to the AUC of the average radiologist (+0.007, p = 0.8115). CONCLUSIONS: Radiologists improved their cancer detection and reduced reading time when evaluating DBT examinations using an AI reading support system. KEY POINTS: • Radiologists improved their cancer detection accuracy in digital breast tomosynthesis (DBT) when using an AI system for support, while simultaneously reducing reading time. • The stand-alone breast cancer detection performance of an AI system is non-inferior to the average performance of radiologists for reading digital breast tomosynthesis exams. • The use of an AI support system could make advanced and more reliable imaging techniques more accessible and could allow for more cost-effective breast screening programs with DBT. |
format | Online Article Text |
id | pubmed-8523448 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-85234482021-10-22 Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study van Winkel, Suzanne L. Rodríguez-Ruiz, Alejandro Appelman, Linda Gubern-Mérida, Albert Karssemeijer, Nico Teuwen, Jonas Wanders, Alexander J. T. Sechopoulos, Ioannis Mann, Ritse M. Eur Radiol Breast OBJECTIVES: Digital breast tomosynthesis (DBT) increases sensitivity of mammography and is increasingly implemented in breast cancer screening. However, the large volume of images increases the risk of reading errors and reading time. This study aims to investigate whether the accuracy of breast radiologists reading wide-angle DBT increases with the aid of an artificial intelligence (AI) support system. Also, the impact on reading time was assessed and the stand-alone performance of the AI system in the detection of malignancies was compared to the average radiologist. METHODS: A multi-reader multi-case study was performed with 240 bilateral DBT exams (71 breasts with cancer lesions, 70 breasts with benign findings, 339 normal breasts). Exams were interpreted by 18 radiologists, with and without AI support, providing cancer suspicion scores per breast. Using AI support, radiologists were shown examination-based and region-based cancer likelihood scores. Area under the receiver operating characteristic curve (AUC) and reading time per exam were compared between reading conditions using mixed-models analysis of variance. RESULTS: On average, the AUC was higher using AI support (0.863 vs 0.833; p = 0.0025). Using AI support, reading time per DBT exam was reduced (p < 0.001) from 41 (95% CI = 39–42 s) to 36 s (95% CI = 35– 37 s). The AUC of the stand-alone AI system was non-inferior to the AUC of the average radiologist (+0.007, p = 0.8115). CONCLUSIONS: Radiologists improved their cancer detection and reduced reading time when evaluating DBT examinations using an AI reading support system. KEY POINTS: • Radiologists improved their cancer detection accuracy in digital breast tomosynthesis (DBT) when using an AI system for support, while simultaneously reducing reading time. • The stand-alone breast cancer detection performance of an AI system is non-inferior to the average performance of radiologists for reading digital breast tomosynthesis exams. • The use of an AI support system could make advanced and more reliable imaging techniques more accessible and could allow for more cost-effective breast screening programs with DBT. Springer Berlin Heidelberg 2021-05-04 2021 /pmc/articles/PMC8523448/ /pubmed/33948701 http://dx.doi.org/10.1007/s00330-021-07992-w Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Breast van Winkel, Suzanne L. Rodríguez-Ruiz, Alejandro Appelman, Linda Gubern-Mérida, Albert Karssemeijer, Nico Teuwen, Jonas Wanders, Alexander J. T. Sechopoulos, Ioannis Mann, Ritse M. Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study |
title | Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study |
title_full | Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study |
title_fullStr | Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study |
title_full_unstemmed | Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study |
title_short | Impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study |
title_sort | impact of artificial intelligence support on accuracy and reading time in breast tomosynthesis image interpretation: a multi-reader multi-case study |
topic | Breast |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8523448/ https://www.ncbi.nlm.nih.gov/pubmed/33948701 http://dx.doi.org/10.1007/s00330-021-07992-w |
work_keys_str_mv | AT vanwinkelsuzannel impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT rodriguezruizalejandro impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT appelmanlinda impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT gubernmeridaalbert impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT karssemeijernico impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT teuwenjonas impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT wandersalexanderjt impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT sechopoulosioannis impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy AT mannritsem impactofartificialintelligencesupportonaccuracyandreadingtimeinbreasttomosynthesisimageinterpretationamultireadermulticasestudy |