Association between the sonographer’s experience and diagnostic performance of IOTA simple rules

BACKGROUND: To validate the clinical value of simple rules in distinguishing malignant adnexal masses from benign ones and to explore the effect of simple rules for experienced and less-experienced sonographers. METHODS: Patients with persistent adnexal masses were enrolled between November 2013 and December 2015. All masses were proven through histological examinations. Five sets of diagnoses were made and compared with one another. Diagnosis 1 was made, according to the simple rules, by a trainee with little clinical diagnostic experience. Diagnoses 2 and 3 were made by experienced and less-experienced sonographers, respectively, according to their clinical experiences. With diagnosis 1 as a reference, the two sonographers were asked to provide a second diagnosis, which were diagnoses 4 and 5. The efficiency of the five sets of diagnoses was compared using ROC curves. RESULTS: In total, 75 malignant (37.7%) and 124 benign lesions (62.3%) were enrolled in this study. The mean diameter of the benign masses was obviously smaller than that of the malignant ones (6.8 ± 3.4 cm vs. 9.3 ± 4.9 cm, p < 0.01). The malignant ratio in postmenopausal women was much higher (66.1%) than that in the premenopausal population (25.7%) (p < 0.0001). Totally, 156 of the 199 cases (79.4%) resulted in conclusive diagnoses. Sensitivity and specificity were 98.4% and 73.9%, respectively, among the conclusive cases. The area under the ROC curve (Az) for the simple rule diagnosis was significantly lower than that for the experienced sonographer diagnosis (0.85 vs. 0.96, p < 0.0001); compared with the less-experienced sonographer, this difference was not significant (0.85 vs. 0.86, p = 0.9776). No significant difference was found in the comparison between the diagnoses made by the experienced sonographer before and after referencing the simple rule diagnosis (Az, 0.96 vs. 0.97, p = 0.2055). Using diagnosis 1 as a reference, the diagnostic performance of the less-experienced sonographer increased (from 0.86 to 0.92, p = 0.012); however, it was still lower than that of the experienced sonographer (Az, 96% vs. 92%, p = 0.0241). CONCLUSIONS: The simple rules was an appealing method for discriminating malignant masses from benign ones, particularly for a less-experienced sonographer.