Comparative validation of the knee inflammation MRI scoring system and the MRI osteoarthritis knee score for semi-quantitative assessment of bone marrow lesions and synovitis-effusion in osteoarthritis: an international multi-reader exercise

BACKGROUND: Bone marrow lesions (BMLs) and synovitis on magnetic resonance imaging (MRI) are associated with symptoms and predict degeneration of articular cartilage in osteoarthritis (OA). Validated methods for their semiquantitative assessment on MRI are available, but they all have similar scoring designs and questionable sensitivity to change. New scoring methods with completely different designs need to be developed and compared to existing methods. OBJECTIVES: To compare the performance of new web-based versions of the Knee Inflammation MRI Scoring System (KIMRISS) with the MRI OA Knee Score (MOAKS) for quantification of BMLs and synovitis-effusion (S-E). DESIGN: Retrospective follow-up cohort. METHODS: We designed web-based overlays outlining regions in the knee that are scored for BML in MOAKS and KIMRISS. For KIMRISS, both BML and S-E are scored on consecutive sagittal slices. The performance of these methods was compared in an international reading exercise of 8 readers evaluating 60 pairs of scans conducted 1 year apart from cases recruited to the OA Initiative (OAI) cohort. Interobserver reliability for baseline status and baseline to 1 year change in BML and S-E was assessed by intra-class correlation coefficient (ICC) and smallest detectable change (SDC). Feasibility was assessed using the System Usability Scale (SUS). RESULTS: Mean change in BML and S-E was minimal over 1 year. Pre-specified targets for acceptable reliability (ICC ⩾ 0.80 and ⩾ 0.70 for status and change scores, respectively) were achieved more frequently for KIMRISS for both BML and synovitis. Mean (95% CI) ICC for change in BML was 0.88 (0.83–0.92) and 0.69 (0.60–0.78) for KIMRISS and MOAKS, respectively. KIMRISS mean SUS usability score was 85.7 and at the 95th centile of ranking for usability versus a score of 55.4 and 20th centile for MOAKS. CONCLUSION: KIMRISS had superior performance metrics to MOAKS for quantification of BML and S-E. Both methods should be further compared in trials of new therapies for OA.