Cargando…

378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study

BACKGROUND: Adaptive platform trials (APTs) have become increasingly popular in recent years in infectious diseases research. However, few studies have compared APT design against conventional randomized clinical trial (RCT) design from a cost-effectiveness standpoint. We aimed to evaluate the cost-...

Descripción completa

Detalles Bibliográficos
Autores principales: Ong, Sean W X, Daneman, Nick, Tong, Steven Y C, Naimark, David
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677415/
http://dx.doi.org/10.1093/ofid/ofad500.448
_version_ 1785150124765216768
author Ong, Sean W X
Daneman, Nick
Tong, Steven Y C
Naimark, David
author_facet Ong, Sean W X
Daneman, Nick
Tong, Steven Y C
Naimark, David
author_sort Ong, Sean W X
collection PubMed
description BACKGROUND: Adaptive platform trials (APTs) have become increasingly popular in recent years in infectious diseases research. However, few studies have compared APT design against conventional randomized clinical trial (RCT) design from a cost-effectiveness standpoint. We aimed to evaluate the cost-effectiveness of APT versus conventional RCTs and quantify the trade-offs involved in choosing between these designs. METHODS: We conducted a model-based economic evaluation using a two-level, hierarchical simulation model comparing two strategies: (1) APT comparing three drugs simultaneously against a single control group, and (2) three sequential 2-arm parallel group conventional RCTs (Fig 1). Cost inputs were obtained from a recently completed conventional RCT studying bloodstream infections (BSI) and a recently launched APT for Gram-negative BSI (Table 1). 1000 Monte Carlo 2nd order iterations were performed to simulate 1000 RCTs to determine empirical Type I and II error rates across several scenario analyses. [Figure: see text] [Figure: see text] RESULTS: In the base case analysis where a less stringent interim analysis stopping rule was used, and the drugs being tested were effective, APT design was associated with lower cost ($5,368,000 vs $8,655,000), shorter duration (135 vs 242 weeks), and lower mean type II error (0.086 vs 0.213) (Table 2). However, results were highly sensitive to different scenario analyses where more stringent stopping rules were applied or if the tested drugs had no true effect. Effect sizes were less precise and on average were over-estimated with APT design (Fig 2). Type I error rates were also consistently higher with the APT strategy (mean error rates of 0.20 and 0.077 using liberal and strict χ(2)(crit) values of 3.841 and 6.635 respectively) compared to conventional design (fixed at 0.05 by design) (Fig 3). [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: We show a proof-of-concept that simulation methods can be used to compare APT and conventional RCT designs for trial planning purposes. Neither strategy was consistently superior in terms of cost-effectiveness. Trade-offs in cost, sample size, and error rates are highly scenario dependent. Choice of trial design should depend on multiple variables, including the study question, probability of efficacy of the drug, and priorities of the investigator (Table 3). [Figure: see text] DISCLOSURES: All Authors: No reported disclosures
format Online
Article
Text
id pubmed-10677415
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-106774152023-11-27 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study Ong, Sean W X Daneman, Nick Tong, Steven Y C Naimark, David Open Forum Infect Dis Abstract BACKGROUND: Adaptive platform trials (APTs) have become increasingly popular in recent years in infectious diseases research. However, few studies have compared APT design against conventional randomized clinical trial (RCT) design from a cost-effectiveness standpoint. We aimed to evaluate the cost-effectiveness of APT versus conventional RCTs and quantify the trade-offs involved in choosing between these designs. METHODS: We conducted a model-based economic evaluation using a two-level, hierarchical simulation model comparing two strategies: (1) APT comparing three drugs simultaneously against a single control group, and (2) three sequential 2-arm parallel group conventional RCTs (Fig 1). Cost inputs were obtained from a recently completed conventional RCT studying bloodstream infections (BSI) and a recently launched APT for Gram-negative BSI (Table 1). 1000 Monte Carlo 2nd order iterations were performed to simulate 1000 RCTs to determine empirical Type I and II error rates across several scenario analyses. [Figure: see text] [Figure: see text] RESULTS: In the base case analysis where a less stringent interim analysis stopping rule was used, and the drugs being tested were effective, APT design was associated with lower cost ($5,368,000 vs $8,655,000), shorter duration (135 vs 242 weeks), and lower mean type II error (0.086 vs 0.213) (Table 2). However, results were highly sensitive to different scenario analyses where more stringent stopping rules were applied or if the tested drugs had no true effect. Effect sizes were less precise and on average were over-estimated with APT design (Fig 2). Type I error rates were also consistently higher with the APT strategy (mean error rates of 0.20 and 0.077 using liberal and strict χ(2)(crit) values of 3.841 and 6.635 respectively) compared to conventional design (fixed at 0.05 by design) (Fig 3). [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: We show a proof-of-concept that simulation methods can be used to compare APT and conventional RCT designs for trial planning purposes. Neither strategy was consistently superior in terms of cost-effectiveness. Trade-offs in cost, sample size, and error rates are highly scenario dependent. Choice of trial design should depend on multiple variables, including the study question, probability of efficacy of the drug, and priorities of the investigator (Table 3). [Figure: see text] DISCLOSURES: All Authors: No reported disclosures Oxford University Press 2023-11-27 /pmc/articles/PMC10677415/ http://dx.doi.org/10.1093/ofid/ofad500.448 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Abstract
Ong, Sean W X
Daneman, Nick
Tong, Steven Y C
Naimark, David
378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
title 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
title_full 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
title_fullStr 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
title_full_unstemmed 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
title_short 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
title_sort 378. cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
topic Abstract
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677415/
http://dx.doi.org/10.1093/ofid/ofad500.448
work_keys_str_mv AT ongseanwx 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy
AT danemannick 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy
AT tongstevenyc 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy
AT naimarkdavid 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy