Cargando…

A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses

We developed a machine learning model based on radiomics to predict the BI-RADS category of ultrasound-detected suspicious breast lesions and support medical decision-making towards short-interval follow-up versus tissue sampling. From a retrospective 2015–2019 series of ultrasound-guided core needl...

Descripción completa

Detalles Bibliográficos
Autores principales: Interlenghi, Matteo, Salvatore, Christian, Magni, Veronica, Caldara, Gabriele, Schiavon, Elia, Cozzi, Andrea, Schiaffino, Simone, Carbonaro, Luca Alessandro, Castiglioni, Isabella, Sardanelli, Francesco
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8774734/
https://www.ncbi.nlm.nih.gov/pubmed/35054354
http://dx.doi.org/10.3390/diagnostics12010187
_version_ 1784636418609381376
author Interlenghi, Matteo
Salvatore, Christian
Magni, Veronica
Caldara, Gabriele
Schiavon, Elia
Cozzi, Andrea
Schiaffino, Simone
Carbonaro, Luca Alessandro
Castiglioni, Isabella
Sardanelli, Francesco
author_facet Interlenghi, Matteo
Salvatore, Christian
Magni, Veronica
Caldara, Gabriele
Schiavon, Elia
Cozzi, Andrea
Schiaffino, Simone
Carbonaro, Luca Alessandro
Castiglioni, Isabella
Sardanelli, Francesco
author_sort Interlenghi, Matteo
collection PubMed
description We developed a machine learning model based on radiomics to predict the BI-RADS category of ultrasound-detected suspicious breast lesions and support medical decision-making towards short-interval follow-up versus tissue sampling. From a retrospective 2015–2019 series of ultrasound-guided core needle biopsies performed by four board-certified breast radiologists using six ultrasound systems from three vendors, we collected 821 images of 834 suspicious breast masses from 819 patients, 404 malignant and 430 benign according to histopathology. A balanced image set of biopsy-proven benign (n = 299) and malignant (n = 299) lesions was used for training and cross-validation of ensembles of machine learning algorithms supervised during learning by histopathological diagnosis as a reference standard. Based on a majority vote (over 80% of the votes to have a valid prediction of benign lesion), an ensemble of support vector machines showed an ability to reduce the biopsy rate of benign lesions by 15% to 18%, always keeping a sensitivity over 94%, when externally tested on 236 images from two image sets: (1) 123 lesions (51 malignant and 72 benign) obtained from two ultrasound systems used for training and from a different one, resulting in a positive predictive value (PPV) of 45.9% (95% confidence interval 36.3–55.7%) versus a radiologists’ PPV of 41.5% (p < 0.005), combined with a 98.0% sensitivity (89.6–99.9%); (2) 113 lesions (54 malignant and 59 benign) obtained from two ultrasound systems from vendors different from those used for training, resulting into a 50.5% PPV (40.4–60.6%) versus a radiologists’ PPV of 47.8% (p < 0.005), combined with a 94.4% sensitivity (84.6–98.8%). Errors in BI-RADS 3 category (i.e., assigned by the model as BI-RADS 4) were 0.8% and 2.7% in the Testing set I and II, respectively. The board-certified breast radiologist accepted the BI-RADS classes assigned by the model in 114 masses (92.7%) and modified the BI-RADS classes of 9 breast masses (7.3%). In six of nine cases, the model performed better than the radiologist did, since it assigned a BI-RADS 3 classification to histopathology-confirmed benign masses that were classified as BI-RADS 4 by the radiologist.
format Online
Article
Text
id pubmed-8774734
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-87747342022-01-21 A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses Interlenghi, Matteo Salvatore, Christian Magni, Veronica Caldara, Gabriele Schiavon, Elia Cozzi, Andrea Schiaffino, Simone Carbonaro, Luca Alessandro Castiglioni, Isabella Sardanelli, Francesco Diagnostics (Basel) Article We developed a machine learning model based on radiomics to predict the BI-RADS category of ultrasound-detected suspicious breast lesions and support medical decision-making towards short-interval follow-up versus tissue sampling. From a retrospective 2015–2019 series of ultrasound-guided core needle biopsies performed by four board-certified breast radiologists using six ultrasound systems from three vendors, we collected 821 images of 834 suspicious breast masses from 819 patients, 404 malignant and 430 benign according to histopathology. A balanced image set of biopsy-proven benign (n = 299) and malignant (n = 299) lesions was used for training and cross-validation of ensembles of machine learning algorithms supervised during learning by histopathological diagnosis as a reference standard. Based on a majority vote (over 80% of the votes to have a valid prediction of benign lesion), an ensemble of support vector machines showed an ability to reduce the biopsy rate of benign lesions by 15% to 18%, always keeping a sensitivity over 94%, when externally tested on 236 images from two image sets: (1) 123 lesions (51 malignant and 72 benign) obtained from two ultrasound systems used for training and from a different one, resulting in a positive predictive value (PPV) of 45.9% (95% confidence interval 36.3–55.7%) versus a radiologists’ PPV of 41.5% (p < 0.005), combined with a 98.0% sensitivity (89.6–99.9%); (2) 113 lesions (54 malignant and 59 benign) obtained from two ultrasound systems from vendors different from those used for training, resulting into a 50.5% PPV (40.4–60.6%) versus a radiologists’ PPV of 47.8% (p < 0.005), combined with a 94.4% sensitivity (84.6–98.8%). Errors in BI-RADS 3 category (i.e., assigned by the model as BI-RADS 4) were 0.8% and 2.7% in the Testing set I and II, respectively. The board-certified breast radiologist accepted the BI-RADS classes assigned by the model in 114 masses (92.7%) and modified the BI-RADS classes of 9 breast masses (7.3%). In six of nine cases, the model performed better than the radiologist did, since it assigned a BI-RADS 3 classification to histopathology-confirmed benign masses that were classified as BI-RADS 4 by the radiologist. MDPI 2022-01-13 /pmc/articles/PMC8774734/ /pubmed/35054354 http://dx.doi.org/10.3390/diagnostics12010187 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Interlenghi, Matteo
Salvatore, Christian
Magni, Veronica
Caldara, Gabriele
Schiavon, Elia
Cozzi, Andrea
Schiaffino, Simone
Carbonaro, Luca Alessandro
Castiglioni, Isabella
Sardanelli, Francesco
A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses
title A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses
title_full A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses
title_fullStr A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses
title_full_unstemmed A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses
title_short A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses
title_sort machine learning ensemble based on radiomics to predict bi-rads category and reduce the biopsy rate of ultrasound-detected suspicious breast masses
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8774734/
https://www.ncbi.nlm.nih.gov/pubmed/35054354
http://dx.doi.org/10.3390/diagnostics12010187
work_keys_str_mv AT interlenghimatteo amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT salvatorechristian amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT magniveronica amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT caldaragabriele amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT schiavonelia amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT cozziandrea amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT schiaffinosimone amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT carbonarolucaalessandro amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT castiglioniisabella amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT sardanellifrancesco amachinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT interlenghimatteo machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT salvatorechristian machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT magniveronica machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT caldaragabriele machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT schiavonelia machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT cozziandrea machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT schiaffinosimone machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT carbonarolucaalessandro machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT castiglioniisabella machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses
AT sardanellifrancesco machinelearningensemblebasedonradiomicstopredictbiradscategoryandreducethebiopsyrateofultrasounddetectedsuspiciousbreastmasses