Deep learning-based carotid plaque vulnerability classification with multicentre contrast-enhanced ultrasound video: a comparative diagnostic study

OBJECTIVES: The aim of this study was to evaluate the performance of deep learning-based detection and classification of carotid plaque (DL-DCCP) in carotid plaque contrast-enhanced ultrasound (CEUS). METHODS AND ANALYSIS: A prospective multicentre study was conducted to assess vulnerability in patients with carotid plaque. Data from 547 potentially eligible patients were prospectively enrolled from 10 hospitals, and 205 patients with CEUS video were finally enrolled for analysis. The area under the receiver operating characteristic curve (AUC) was used to evaluate the effectiveness of DL-DCCP and two experienced radiologists who manually examined the CEUS video (RA-CEUS) in diagnosing and classifying carotid plaque vulnerability. To evaluate the influence of dynamic video input on the performance of the algorithm, a state-of-the-art deep convolutional neural network (CNN) model for static images (Xception) was compared with DL-DCCP for both training and holdout validation cohorts. RESULTS: The AUCs of DL-DCCP were significantly better than those of the experienced radiologists for both the training and holdout validation cohorts (training, DL-DCCP vs RA-CEUS, AUC: 0.85 vs 0.69, p<0.01; holdout validation, DL-DCCP vs RA-CEUS, AUC: 0.87 vs 0.66, p<0.01), that is, also better than the best deep CNN model Xception we had performed, for both the training and holdout validation cohorts (training, DL-DCCP vs Xception, AUC:0.85 vs 0.82, p<0.01; holdout validation, DL-DCCP vs Xception, AUC: 0.87 vs 0.77, p<0.01). CONCLUSION: DL-DCCP shows better overall performance in assessing the vulnerability of carotid atherosclerotic plaques than RA-CEUS. Moreover, with a more powerful network structure and better utilisation of video information, DL-DCCP provided greater diagnostic accuracy than a state-of-the-art static CNN model. TRIAL REGISTRATION NUMBER: ChiCTR1900021846,