Comparison of semi-quantitative and visual assessment of early MRI signal evolution in acute ischaemic stroke

BACKGROUND: The evaluation of DWI/FLAIR mismatch in ischaemic stroke patients with unknown, time from onset can determine the treatment strategy. This approach is based on, visual assessment and may be subject to insufficient inter-rater agreement. OBJECTIVE: To compare the inter-rater agreement of visual evaluation of FLAIR MRI and proposed region of interest (ROI) semiquantitative method in large vessel occlusion (LVO) strokes. METHODS: Five readers have analysed MRIs of 104 patients obtained within six hours of the onset of stroke symptoms resulting from LVO visually and semi-quantitatively. For the semiquantitative analysis, a ROI method was used to obtain relative signal intensity compared to the unaffected side. Cut-off values of 1.15 and 1.10 were tested. The analysis yielded FLAIR-positive (abnormal) and negative (normal) findings. Percentage agreement and Fleiss kappa coefficients were calculated. RESULTS: The visual agreement of 5/5 readers and ≥ 4/5 readers occurred in 31% and 59% of cases respectively. Semi-quantitative evaluation using a cut-off value of 1.15 increased the agreements to 67% and 88% respectively. The agreement of visual evaluation was fair. The semi-quantitative method utilising the cut-off of 1.15 had moderate agreement although it increased the number of FLAIR-negative results compared to the visual evaluation. A low cut-off value of 1.10 didn’t improve the agreement significantly. CONCLUSION: The inter-rater agreement of visual evaluation of FLAIR in patients with short-duration large vessel occlusion stroke was fair. The high cut-off value of semiquantitative evaluation increased the agreement although it changed the proportion of FLAIR positive and negative results.