Effect of differences in O-RADS lexicon interpretation between senior and junior sonologists on O-RADS classification and diagnostic performance

PURPOSE: To assess the consistency of Ovarian-Adnexal Reporting and Data System (O-RADS) lexicon interpretation between senior and junior sonologists and to investigate its impact on O-RADS classification and diagnostic performance. METHODS: We prospectively studied 620 patients with adnexal lesions, all of whom underwent transvaginal or transrectal ultrasound performed by a senior sonologist (R1) who selected the O-RADS lexicon description and O-RADS category for the lesion after the examination. Meanwhile, the junior sonologist (R2) analyzed the images retained by R1 and divided the lesion in the same way. Pathological findings were used as a reference standard. kappa (к) statistics were used to assess the interobserver agreement. RESULTS: Of the 620 adnexal lesions, 532 were benign and 88 were malignant. When using the O-RADS lexicon, R1 and R2 had almost perfect agreement regarding lesion category, external contour of solid lesions, presence of papillary inside cystic lesions, and fluid echogenicity (к: 0.81–1.00). Substantial agreement in solid components, acoustic shadow, vascularity and O-RADS categories (к: 0.61–0.80). Consistency in classifying classic benign lesions in the O-RADS category was only moderate (к = 0.535). No significant difference in diagnostic performance between them using O-RADS (P = 0.1211). CONCLUSION: There was good agreement between senior and junior sonologists in the interpretation of the O-RADS lexicon and in the classification of O-RADS, except for a moderate agreement in the interpretation and classification of classic benign lesions. Differences in O-RADS category delineation between sonologists had no significant effect on the diagnostic performance of O-RADS.