Comparison of Chest CT Grading Systems in Coronavirus Disease 2019 (COVID-19) Pneumonia

PURPOSE: To compare the performance and interobserver agreement of the COVID-19 Reporting and Data System (CO-RADS), the COVID-19 imaging reporting and data system (COVID-RADS), the RSNA expert consensus statement, and the British Society of Thoracic Imaging (BSTI) guidance statement. MATERIALS AND METHODS: In this case-control study, total of 100 symptomatic patients suspected of having COVID-19 were included: 50 patients with COVID-19 (59±17 years, 38 men) and 50 patients without COVID-19 (65±24 years, 30 men). Eight radiologists independently scored chest CT images of the cohort according to each reporting system. The area under the receiver operating characteristic curves (AUC) and interobserver agreements were calculated and statistically compared across the systems. RESULTS: A total of 800 observations were made for each system. The level of suspicion of COVID-19 correlated with the RT-PCR positive rate except for the “negative for pneumonia” classifications in all the systems (Spearman’s coefficient: ρ=1.0, P=<.001 for all the systems). Average AUCs were as follows: CO-RADS, 0.84 (95% confidence interval, 0.83–0.85): COVID-RADS, 0.80 (0.78–0.81): the RSNA statement, 0.81 (0.79–0.82): and the BSTI statement, 0.84 (0.812-0.86). Average Cohen’s kappa across observers was 0.62 (95% confidence interval, 0.58–0.66), 0.63 (0.58–0.68), 0.63 (0.57–0.69), and 0.61 (0.58-0.64) for CO-RADS, COVID-RADS, the RSNA statement and the BSTI statement, respectively. CO-RADS and the BSTI statement outperformed COVID-RADS and the RSNA statement in diagnostic performance (P=.<.05 for all the comparison). CONCLUSIONS: CO-RADS, COVID-RADS, the RSNA statement and the BSTI statement provided reasonable performances and interobserver agreements in reporting CT findings of COVID-19.