A benchmarking study of two trauma centres highlighting limitations when standardising mortality for comorbidity

INTRODUCTION: A continuous process of trauma centre evaluation is essential to ensure the development and progression of trauma care at regional, national and international levels. Evaluation may be by comparison between pooled datasets or by direct benchmarking between centres. This study attempts to benchmark mortality at two trauma centres standardising this for multiple case-mix factors, which includes the prevalence of individual background pre-existing diseases within the study population. METHODS: Trauma patients with an Injury Severity Score (ISS) >15 admitted to the two centres in 2001 and 2002 were included in the study with the exception of those who died in the emergency department. Patient characteristics were analysed in terms of 18 case-mix factors including Glasgow Coma Scale on arrival, Injury Severity Score and the presence or absence of 9 co-morbidity types, and patient outcome was compared based on in-hospital mortality before and after standardisation. RESULTS: Crude mortality was greater at UHNS (18.2 vs 14.5%) with a non-significant odds ratio of 1.31 prior to adjusting for case-mix (P = 0.171). Adjustment for case mix using logistic regression analysis altered the odds ratio to 1.64, which was not significant (P = 0.069). DISCUSSION: This study did not demonstrate any significant difference in the outcome of patients treated at either hospital during the study period. More importantly it has raised several important methodological issues pertinent to researchers undertaking registry based benchmarking studies. Data at the two registries was collected by personnel with differing backgrounds, in formats that were not completely compatible and was collected for patients that met different admissions criteria. The inclusion of a meaningful analysis of pre-existing disease was limited by the availability of robust data and sample size. We suggest greater communication between trauma research coordinators to ensure equivalent data collection and facilitate future benchmarking studies.