Accuracy of clinical predictions of prognosis at the end-of-life: evidence from routinely collected data in urgent care records

BACKGROUND: The accuracy of prognostication has important implications for patients, families, and health services since it may be linked to clinical decision-making, patient experience and outcomes and resource allocation. Study aim is to evaluate the accuracy of temporal predictions of survival in patients with cancer, dementia, heart, or respiratory disease. METHODS: Accuracy of clinical prediction was evaluated using retrospective, observational cohort study of 98,187 individuals with a Coordinate My Care record, the Electronic Palliative Care Coordination System serving London, 2010–2020. The survival times of patients were summarised using median and interquartile ranges. Kaplan Meier survival curves were created to describe and compare survival across prognostic categories and disease trajectories. The extent of agreement between estimated and actual prognosis was quantified using linear weighted Kappa statistic. RESULTS: Overall, 3% were predicted to live “days”; 13% “weeks”; 28% “months”; and 56% “year/years”. The agreement between estimated and actual prognosis using linear weighted Kappa statistic was highest for patients with dementia/frailty (0.75) and cancer (0.73). Clinicians’ estimates were able to discriminate (log-rank p < 0.001) between groups of patients with differing survival prospects. Across all disease groups, the accuracy of survival estimates was high for patients who were likely to live for fewer than 14 days (74% accuracy) or for more than one year (83% accuracy), but less accurate at predicting survival of “weeks” or “months” (32% accuracy). CONCLUSION: Clinicians are good at identifying individuals who will die imminently and those who will live for much longer. The accuracy of prognostication for these time frames differs across major disease categories, but remains acceptable even in non-cancer patients, including patients with dementia. Advance Care Planning and timely access to palliative care based on individual patient needs may be beneficial for those where there is significant prognostic uncertainty; those who are neither imminently dying nor expected to live for “years”. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12904-023-01155-y.