Methodological Challenges and Statistical Approaches in the COMprehensive Post-Acute Stroke Services Study

The COMprehensive Post-Acute Stroke Services study was a cluster-randomized pragmatic trial designed to evaluate a comprehensive care transitions model versus usual care. The data collected during this trial were complex and analysis methodology was required that could simultaneously account for the cluster-randomized design, missing patient-level covariates, outcome nonresponse, and substantial nonadherence to the intervention. OBJECTIVE: The objective of this study was to discuss an array of complementary statistical methods to evaluate treatment effectiveness that appropriately addressed the challenges presented by the complex data arising from this pragmatic trial. METHODS: We utilized multiple imputation combined with inverse probability weighting to account for missing covariate and outcome data in the estimation of intention-to-treat effects (ITT). The ITT estimand reflects the effectiveness of assignment to the COMprehensive Post-Acute Stroke Services intervention compared with usual care (ie, it does not take into account intervention adherence). Per-protocol analyses provide complementary information about the effect of treatment, and therefore are relevant for patients to inform their decision-making. We describe estimation of the complier average causal effect using an instrumental variables approach through 2-stage least squares estimation. For all preplanned analyses, we also discuss additional sensitivity analyses. DISCUSSION: Pragmatic trials are well suited to inform clinical practice. Care should be taken to proactively identify the appropriate balance between control and pragmatism in trial design. Valid estimation of ITT and per-protocol effects in the presence of complex data requires application of appropriate statistical methods and concerted efforts to ensure high-quality data are collected.