MultiCenter Interrupted Time Series Analysis: Incorporating Within and Between-Center Heterogeneity

BACKGROUND: Segmented regression (SR) is the most common statistical method used in the analysis of interrupted time series (ITS) data. However, this modeling strategy is indicated to produce spurious results when applied to aggregated data. For multicenter ITS studies, data at a given time point are often aggregated across different participants and settings; thus, conventional segmented regression analysis may not be an optimal approach. Our objective is to provide a robust method for analysis of ITS data, while accounting for two sources of heterogeneity, between participants and across sites. METHODS: We present a methodological framework within the segmented regression modeling strategy, where we introduced weights to account for between-participant variation and the differences across multiple sites. We empirically compared the proposed weighted segmented regression (wSR) with the conventional SR as well as with a previously published pooled analysis method using data from the Mobility of Vulnerable Elders in Ontario (MOVE-ON) project, a multisite ITS study. RESULTS: Overall, the wSR produced the most precise estimates, where they had the narrowest 95% CI, while the conventional SR method resulted in the least precise estimates. Our method also resulted in increased power. The pooled analysis method and the wSR had comparable results when there were ≤4 sites included in the overall analysis and when there was moderate to high between-site heterogeneity as measured by the I(2) statistic. CONCLUSION: Incorporating participant-level and site-level variability led to estimates that were more precise and accurate in determining the magnitude of the effect of an intervention and led to increased statistical power. This underscores the importance of accounting for the inherent variability in aggregated data. Extensive simulations are required to further assess the methods in a wide range of scenarios and outcome types.