The impact of an ultrasound atlas for scoring salivary glands in primary Sjögren’s syndrome: a pilot study

The objective of this pilot study was to assess the impact of a salivary gland ultrasound (SGUS) atlas for scoring parenchymal changes in Sjögren’s syndrome by assessing the reliability of the scoring system (0–3), without and with the use of the SGUS atlas. Ten participants with varying experience in SGUS contributed to the reliability exercise. Thirty SGUS images of the submandibular and parotid gland with abnormalities ranging from 0 to 3 were scored using the written definitions of the OMERACT SGUS scoring system and using the SGUS atlas based on the OMERACT scoring system. For intra-reader reliability, two rounds were performed without and with the atlas—in the 2nd round the 30 images were rearranged in random order by a physician not included in the scoring. Inter-reader reliability was also determined in both rounds. Without using the atlas, the SGUS OMERACT scoring system showed fair inter-reader reliability in round 1 (mean kappa 0.36; range 0.06–0.69) and moderate intra-reader reliability (mean kappa 0.55; range 0.28–0.81). With the atlas, inter-reader reliability improved in round 1 to moderate (mean kappa 0.52; range 0.31–0.77) and intra-reader reliability to good (mean kappa 0.69; range 0.46–0.86). Higher intra-reader reliability was noted in participants with previous SGUS experience. The SGUS atlas increased both intra- and inter-reader reliability for scoring gland pathology in participants with varying SGUS experience suggesting a possible future role in clinical practice and trials.