How Much Participant Outcome Data Is Missing from Sight: Findings from a Cohort of Trials Submitted to a German Research Ethics Committee

BACKGROUND: Study publication bias and outcome reporting bias have been recognised as two threats to the validity of systematic reviews. The purpose of this research was to estimate the proportion of missing participant outcome data from randomised controlled trials (RCTs) due to lack of publication of whole studies and due to outcome data missing within study publications. METHODS AND FINDINGS: Data were extracted from protocols of clinical research projects submitted to the research ethics committee of the University of Freiburg (Germany) between 2000 and 2002 and associated fully published articles. The total amount of published and unpublished outcome data from all trial participants was calculated for each trial and the overall proportion of missing data from both unpublished and published trials computed. Full and partially reported outcome data was also taken into consideration. The impact of funding source on missingness was also considered at the trial level. From 308 parallel group trials in the study cohort, 167 were published and 141 were unpublished. Overall, 260,563 participants contributed to a total of 2,618,116 participant outcome data across all trials. About half (47%) of the participant outcome data from the 308 trials was reported in full but at least 81% were partially reported. Of the 19% of participant data that were missing, 4% was attributable to missing data from published trials and 15% from unpublished trials. Commercially funded trials had a higher probability of publication (relative risk 1.20, 95% confidence interval 0.86, 1.67; p = 0.27) but were less likely to fully report all outcomes than non-commercially funded trials (relative risk 0.64, 95% confidence interval 0.30, 1.38; p = 0.26). CONCLUSIONS: Missing participant outcome data from both published and unpublished trials is frequent. Clinical trial registration including outcome information not only identifies that clinical trials exist but the systematic examination and monitoring of trial information within a registry can help detect selective reporting of entire studies and of outcome data within studies and possibly prevent it.