Longitudinal studies that use data collected as part of usual care risk reporting biased results: a systematic review

BACKGROUND: Longitudinal studies using data collected as part of usual care risk providing biased results if visit times are related to the outcome of interest. Statistical methods for mitigating this bias are available but rarely used. This lack of use could be attributed to a lack of need or to a lack of awareness of the issue. METHODS: We performed a systematic review of longitudinal studies that used data collected as part of patients’ usual care and were published in MEDLINE or EMBASE databases between January 2005 through May 13(th) 2015. We asked whether the extent of and reasons for variability in visit times were reported on, and in cases where there was a need to account for informativeness of visit times, whether an appropriate method was used. RESULTS: Of 44 eligible articles, 57% (n = 25) reported on the total follow-up time, 7% (n = 3) on the gaps between visits, and 57% (n = 25) on the number of visits per patient; 78% (n = 34) reported on at least one of these. Two studies assessed predictors of visit times, and 86% of studies did not report enough information to assess whether there was a need to account for informative follow-up. Only one study used a method designed to account for informative visit times. CONCLUSIONS: The low proportion of studies reporting on whether there were important predictors of visit times suggests that researchers are unaware of the potential for bias when data is collected as part of usual care and visit times are irregular. Guidance on the potential for bias and on the reporting of longitudinal studies subject to irregular follow-up is needed. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1186/s12874-017-0418-1) contains supplementary material, which is available to authorized users.