Cargando…
Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study
Objectives: This study aims to develop an automatic deep-learning algorithm, which is based on Convolutional Neural Networks (CNNs), for ultrasound informative-image selection of hyaline cartilage at metacarpal head level. The algorithm performance and that of three beginner sonographers were compar...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7956959/ https://www.ncbi.nlm.nih.gov/pubmed/33732711 http://dx.doi.org/10.3389/fmed.2021.589197 |
_version_ | 1783664552098922496 |
---|---|
author | Cipolletta, Edoardo Fiorentino, Maria Chiara Moccia, Sara Guidotti, Irene Grassi, Walter Filippucci, Emilio Frontoni, Emanuele |
author_facet | Cipolletta, Edoardo Fiorentino, Maria Chiara Moccia, Sara Guidotti, Irene Grassi, Walter Filippucci, Emilio Frontoni, Emanuele |
author_sort | Cipolletta, Edoardo |
collection | PubMed |
description | Objectives: This study aims to develop an automatic deep-learning algorithm, which is based on Convolutional Neural Networks (CNNs), for ultrasound informative-image selection of hyaline cartilage at metacarpal head level. The algorithm performance and that of three beginner sonographers were compared with an expert assessment, which was considered the gold standard. Methods: The study was divided into two steps. In the first one, an automatic deep-learning algorithm for image selection was developed using 1,600 ultrasound (US) images of the metacarpal head cartilage (MHC) acquired in 40 healthy subjects using a very high-frequency probe (up to 22 MHz). The algorithm task was to identify US images defined informative as they show enough information to fulfill the Outcome Measure in Rheumatology US definition of healthy hyaline cartilage. The algorithm relied on VGG16 CNN, which was fine-tuned to classify US images in informative and non-informative ones. A repeated leave-four-subject out cross-validation was performed using the expert sonographer assessment as gold-standard. In the second step, the expert assessed the algorithm and the beginner sonographers' ability to obtain US informative images of the MHC. Results: The VGG16 CNN showed excellent performance in the first step, with a mean area (AUC) under the receiver operating characteristic curve, computed among the 10 models obtained from cross-validation, of 0.99 ± 0.01. The model that reached the best AUC on the testing set, which we named “MHC identifier 1,” was then evaluated by the expert sonographer. The agreement between the algorithm, and the expert sonographer was almost perfect [Cohen's kappa: 0.84 (95% confidence interval: 0.71–0.98)], whereas the agreement between the expert and the beginner sonographers using conventional assessment was moderate [Cohen's kappa: 0.63 (95% confidence interval: 0.49–0.76)]. The conventional obtainment of US images by beginner sonographers required 6.0 ± 1.0 min, whereas US videoclip acquisition by a beginner sonographer lasted only 2.0 ± 0.8 min. Conclusion: This study paves the way for the automatic identification of informative US images for assessing MHC. This may redefine the US reliability in the evaluation of MHC integrity, especially in terms of intrareader reliability and may support beginner sonographers during US training. |
format | Online Article Text |
id | pubmed-7956959 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-79569592021-03-16 Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study Cipolletta, Edoardo Fiorentino, Maria Chiara Moccia, Sara Guidotti, Irene Grassi, Walter Filippucci, Emilio Frontoni, Emanuele Front Med (Lausanne) Medicine Objectives: This study aims to develop an automatic deep-learning algorithm, which is based on Convolutional Neural Networks (CNNs), for ultrasound informative-image selection of hyaline cartilage at metacarpal head level. The algorithm performance and that of three beginner sonographers were compared with an expert assessment, which was considered the gold standard. Methods: The study was divided into two steps. In the first one, an automatic deep-learning algorithm for image selection was developed using 1,600 ultrasound (US) images of the metacarpal head cartilage (MHC) acquired in 40 healthy subjects using a very high-frequency probe (up to 22 MHz). The algorithm task was to identify US images defined informative as they show enough information to fulfill the Outcome Measure in Rheumatology US definition of healthy hyaline cartilage. The algorithm relied on VGG16 CNN, which was fine-tuned to classify US images in informative and non-informative ones. A repeated leave-four-subject out cross-validation was performed using the expert sonographer assessment as gold-standard. In the second step, the expert assessed the algorithm and the beginner sonographers' ability to obtain US informative images of the MHC. Results: The VGG16 CNN showed excellent performance in the first step, with a mean area (AUC) under the receiver operating characteristic curve, computed among the 10 models obtained from cross-validation, of 0.99 ± 0.01. The model that reached the best AUC on the testing set, which we named “MHC identifier 1,” was then evaluated by the expert sonographer. The agreement between the algorithm, and the expert sonographer was almost perfect [Cohen's kappa: 0.84 (95% confidence interval: 0.71–0.98)], whereas the agreement between the expert and the beginner sonographers using conventional assessment was moderate [Cohen's kappa: 0.63 (95% confidence interval: 0.49–0.76)]. The conventional obtainment of US images by beginner sonographers required 6.0 ± 1.0 min, whereas US videoclip acquisition by a beginner sonographer lasted only 2.0 ± 0.8 min. Conclusion: This study paves the way for the automatic identification of informative US images for assessing MHC. This may redefine the US reliability in the evaluation of MHC integrity, especially in terms of intrareader reliability and may support beginner sonographers during US training. Frontiers Media S.A. 2021-03-01 /pmc/articles/PMC7956959/ /pubmed/33732711 http://dx.doi.org/10.3389/fmed.2021.589197 Text en Copyright © 2021 Cipolletta, Fiorentino, Moccia, Guidotti, Grassi, Filippucci and Frontoni. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Medicine Cipolletta, Edoardo Fiorentino, Maria Chiara Moccia, Sara Guidotti, Irene Grassi, Walter Filippucci, Emilio Frontoni, Emanuele Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study |
title | Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study |
title_full | Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study |
title_fullStr | Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study |
title_full_unstemmed | Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study |
title_short | Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study |
title_sort | artificial intelligence for ultrasound informative image selection of metacarpal head cartilage. a pilot study |
topic | Medicine |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7956959/ https://www.ncbi.nlm.nih.gov/pubmed/33732711 http://dx.doi.org/10.3389/fmed.2021.589197 |
work_keys_str_mv | AT cipollettaedoardo artificialintelligenceforultrasoundinformativeimageselectionofmetacarpalheadcartilageapilotstudy AT fiorentinomariachiara artificialintelligenceforultrasoundinformativeimageselectionofmetacarpalheadcartilageapilotstudy AT mocciasara artificialintelligenceforultrasoundinformativeimageselectionofmetacarpalheadcartilageapilotstudy AT guidottiirene artificialintelligenceforultrasoundinformativeimageselectionofmetacarpalheadcartilageapilotstudy AT grassiwalter artificialintelligenceforultrasoundinformativeimageselectionofmetacarpalheadcartilageapilotstudy AT filippucciemilio artificialintelligenceforultrasoundinformativeimageselectionofmetacarpalheadcartilageapilotstudy AT frontoniemanuele artificialintelligenceforultrasoundinformativeimageselectionofmetacarpalheadcartilageapilotstudy |