External validation of the PRIORITY model in predicting COVID-19 critical illness in vaccinated and unvaccinated patients

OBJECTIVES: Predictive scores are important tools for the triage of patients with coronavirus disease 2019. The PRIORITY score is advantageous because it does not require laboratory and radiologic information. However, the original development and validation cohorts studied only unvaccinated patients in early 2020. We aimed to externally validate the PRIORITY score in a cohort of patients with the novel delta and omicron variants of coronavirus disease 2019 and mixed vaccination status. METHODS: A total of 410 patients were included in a cross-sectional sampling of all patients admitted to the National Centre of Infectious Diseases on October 27, 2021. A further 102 and 136 patients with vaccine-breakthrough Delta and Omicron variant infection from April to August and December 2021, respectively, were also included. Variables at the time of admission were collected retrospectively from medical records and used to calculate the probability of deterioration using the PRIORITY model. RESULTS: Of the total 648 included patients, 447 (69.0%) were vaccinated. The mean age was 61.6 years (standard deviation ± 19.0 years), and 268 patients (41.4%) were female. A total of 112 patients (17.3%) met the primary outcome of developing critical illness or mortality. The performance of the score in this cohort was comparable with the original cohorts, with an area under the receiver operating characteristic curve for all patients of 0.794 (95% CI, 0.752–0.835; p < 0.001), regression coefficient of 1.069, and intercept of 0.04. Subgroup analysis of unvaccinated and vaccinated patients showed that performance was superior in vaccinated individuals, with an area under the receiver operating characteristic curve of 0.684 (95% CI, 0.608–0.760; p < 0.0001) and 0.831 (95% CI, 0.772–0.891; p < 0.0001), respectively. DISCUSSION: Our data support the continued use of the PRIORITY score in this era of novel variants and increased vaccination uptake.