Understanding the challenge of comparative effectiveness research in focal epilepsy: A review of network meta‐analyses and real‐world evidence on antiepileptic drugs

OBJECTIVE: Head‐to‐head randomized controlled trials (RCTs) are the gold standard for assessing comparative treatment effects. In the absence of direct comparisons between all possible antiepileptic drugs (AEDs), however, clinical decision‐making in focal (partial onset) epilepsy relies on alternative evidence borne from indirect comparisons including network meta‐analyses (NMAs) and from real‐world evidence (RWE) studies. We review NMAs and observational RWE studies comparing AEDs in the adjunctive setting to compare the robustness of these methods and to formulate recommendations for future evidence development. METHODS: A literature review identified NMAs and RWE studies comparing AEDs for the adjunctive treatment of focal seizures published between January 2008 and October 2018. NMAs were evaluated for robustness using a framework based on guidelines from the National Institute for Health and Care Excellence Decision Support Unit and the International Society for Pharmacoeconomics and Outcomes Research. RWE studies were evaluated using the GRACE checklist. RESULTS: From a total of 1993 records, 11 NMAs and six RWE studies were eligible. Key limitations identified in the NMAs include nonsystematic selection of RCTs, unexplored heterogeneity between included RCTs in terms of study and patient characteristics, and selection of AEDs and AED doses or dosing strategies that are not reflective of clinical practice. The main limitations of RWE studies concern sample size, design, and analysis methods. Approximately 90% of comparisons between individual AEDs were nonsignificant in the NMAs. None of the RWE studies adjusted for baseline differences between comparator groups; therefore, they lack the validity to make comparative conclusions. SIGNIFICANCE: Current NMAs and RWE studies provide only nominal comparative evidence for AED treatments in focal epilepsy, and should be used with caution for decision‐making due to their methodological limitations. To overcome these hurdles, adherence to methodological guidelines and concerted efforts to collect relevant outcome data in the real world are needed.