Effect estimate comparison between the prescription sequence symmetry analysis (PSSA) and parallel group study designs: A systematic review

Prescription sequence symmetry analysis (PSSA), a case-only design introduced in 1996, has been increasingly used to identify unintentional drug effects, and has potential applications as a hypothesis-testing and a hypothesis-generating method, due to its easy application and effective control of time-invariant confounders. The aim of this study is to systematically compare effect estimates from the PSSA to effect estimates from conventional observational parallel group study designs, to assess the validity and constraints of the PSSA study design. We reviewed the MEDLINE, EMBASE, and Web of Science databases until February 2016 to identify studies that compared PSSA to a parallel group design. Data from the eligible articles was extracted and analyzed, including making a Bland-Altman plot and calculating the number of discrepancies between the designs. 63 comparisons (from two studies) were included in the review. There was a significant correlation (p < 0.001) between the effect estimates of the PSSA and the parallel group designs, but the bias indicated by the Bland-Altman plot (0.20) and the percentage of discrepancies (70–80%) showed that this correlation was not accompanied by a considerable similarity of the effect estimates. Overall, the effect estimates of the parallel group designs were higher than those of the PSSA, not necessarily further away from 1, and the parallel group designs also generated more significant signals. However, these results should be approached with caution, as the effect estimates were only retrieved from two separate studies. This review indicates that, even though PSSA has a lot of potential, the effect estimates generated by the PSSA are usually lower than the effect estimates generated by parallel group designs, and PSSA mostly has a lower power than the conventional study designs, but this is based on limited comparisons, and more comparisons are needed to make a proper conclusion.