Measuring Health-Related Quality of Life in Randomised Controlled Trials: Expected and Reported Results Do Not Match

PURPOSE: The assessment of health-related quality of life (hrQoL) may need to be reconsidered due to important differences between efficacy (the effect of a treatment under experimental study conditions) and effectiveness (the effect of a treatment under real-world conditions). We presume that most researchers intend to describe effects under real-world conditions when investigating hrQoL as an endpoint. Unfortunately, most studies are designed to confirm two theories: the efficacy of a new intervention under experimental study conditions and the real-world effectiveness of this intervention on hrQoL under non-experimental study conditions. Conflicting information emerges when the outcomes are supposed to describe effects under real-world conditions, but the assessment generates results obtained under experimental conditions. This paper examines the existing conflict between efficacy and effectiveness in a sample of 100 studies investigating hrQoL. METHODS: We analysed a sample of freely available publications of clinical studies listed in PubMed between April 2015 and August 2016 which assessed quality of life as an outcome. We assessed the following four characteristics that should differ in studies measuring either efficacy or effectiveness: 1) specification of the study as a randomised controlled trial or not, 2) description of the study design as pragmatic or not, 3) classification of the study as an efficacy or an effectiveness study and 4) number of selected inclusion and exclusion criteria. RESULTS: 91% of the studies assessed hrQoL under experimental conditions (in a randomised controlled trial), but not under real-world conditions. The important difference between efficacy and effectiveness was not described in 60% of the studies. Only 6% of studies classified the study as a pragmatic trial. The difference between inclusion and exclusion criteria was not addressed in any of the investigated studies. CONCLUSION: The results of the four criteria confirmed our hypothesis that hrQoL studies are conducted mainly as experimental, but not pragmatic, trials indicating that the meaningfulness of the important difference between efficacy and effectiveness requires further discussion. KEYWORDS: pragmatic trial, experimental study conditions, real-world conditions, efficacy, effectiveness, pragmatic.