Cargando…
378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study
BACKGROUND: Adaptive platform trials (APTs) have become increasingly popular in recent years in infectious diseases research. However, few studies have compared APT design against conventional randomized clinical trial (RCT) design from a cost-effectiveness standpoint. We aimed to evaluate the cost-...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677415/ http://dx.doi.org/10.1093/ofid/ofad500.448 |
_version_ | 1785150124765216768 |
---|---|
author | Ong, Sean W X Daneman, Nick Tong, Steven Y C Naimark, David |
author_facet | Ong, Sean W X Daneman, Nick Tong, Steven Y C Naimark, David |
author_sort | Ong, Sean W X |
collection | PubMed |
description | BACKGROUND: Adaptive platform trials (APTs) have become increasingly popular in recent years in infectious diseases research. However, few studies have compared APT design against conventional randomized clinical trial (RCT) design from a cost-effectiveness standpoint. We aimed to evaluate the cost-effectiveness of APT versus conventional RCTs and quantify the trade-offs involved in choosing between these designs. METHODS: We conducted a model-based economic evaluation using a two-level, hierarchical simulation model comparing two strategies: (1) APT comparing three drugs simultaneously against a single control group, and (2) three sequential 2-arm parallel group conventional RCTs (Fig 1). Cost inputs were obtained from a recently completed conventional RCT studying bloodstream infections (BSI) and a recently launched APT for Gram-negative BSI (Table 1). 1000 Monte Carlo 2nd order iterations were performed to simulate 1000 RCTs to determine empirical Type I and II error rates across several scenario analyses. [Figure: see text] [Figure: see text] RESULTS: In the base case analysis where a less stringent interim analysis stopping rule was used, and the drugs being tested were effective, APT design was associated with lower cost ($5,368,000 vs $8,655,000), shorter duration (135 vs 242 weeks), and lower mean type II error (0.086 vs 0.213) (Table 2). However, results were highly sensitive to different scenario analyses where more stringent stopping rules were applied or if the tested drugs had no true effect. Effect sizes were less precise and on average were over-estimated with APT design (Fig 2). Type I error rates were also consistently higher with the APT strategy (mean error rates of 0.20 and 0.077 using liberal and strict χ(2)(crit) values of 3.841 and 6.635 respectively) compared to conventional design (fixed at 0.05 by design) (Fig 3). [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: We show a proof-of-concept that simulation methods can be used to compare APT and conventional RCT designs for trial planning purposes. Neither strategy was consistently superior in terms of cost-effectiveness. Trade-offs in cost, sample size, and error rates are highly scenario dependent. Choice of trial design should depend on multiple variables, including the study question, probability of efficacy of the drug, and priorities of the investigator (Table 3). [Figure: see text] DISCLOSURES: All Authors: No reported disclosures |
format | Online Article Text |
id | pubmed-10677415 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-106774152023-11-27 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study Ong, Sean W X Daneman, Nick Tong, Steven Y C Naimark, David Open Forum Infect Dis Abstract BACKGROUND: Adaptive platform trials (APTs) have become increasingly popular in recent years in infectious diseases research. However, few studies have compared APT design against conventional randomized clinical trial (RCT) design from a cost-effectiveness standpoint. We aimed to evaluate the cost-effectiveness of APT versus conventional RCTs and quantify the trade-offs involved in choosing between these designs. METHODS: We conducted a model-based economic evaluation using a two-level, hierarchical simulation model comparing two strategies: (1) APT comparing three drugs simultaneously against a single control group, and (2) three sequential 2-arm parallel group conventional RCTs (Fig 1). Cost inputs were obtained from a recently completed conventional RCT studying bloodstream infections (BSI) and a recently launched APT for Gram-negative BSI (Table 1). 1000 Monte Carlo 2nd order iterations were performed to simulate 1000 RCTs to determine empirical Type I and II error rates across several scenario analyses. [Figure: see text] [Figure: see text] RESULTS: In the base case analysis where a less stringent interim analysis stopping rule was used, and the drugs being tested were effective, APT design was associated with lower cost ($5,368,000 vs $8,655,000), shorter duration (135 vs 242 weeks), and lower mean type II error (0.086 vs 0.213) (Table 2). However, results were highly sensitive to different scenario analyses where more stringent stopping rules were applied or if the tested drugs had no true effect. Effect sizes were less precise and on average were over-estimated with APT design (Fig 2). Type I error rates were also consistently higher with the APT strategy (mean error rates of 0.20 and 0.077 using liberal and strict χ(2)(crit) values of 3.841 and 6.635 respectively) compared to conventional design (fixed at 0.05 by design) (Fig 3). [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: We show a proof-of-concept that simulation methods can be used to compare APT and conventional RCT designs for trial planning purposes. Neither strategy was consistently superior in terms of cost-effectiveness. Trade-offs in cost, sample size, and error rates are highly scenario dependent. Choice of trial design should depend on multiple variables, including the study question, probability of efficacy of the drug, and priorities of the investigator (Table 3). [Figure: see text] DISCLOSURES: All Authors: No reported disclosures Oxford University Press 2023-11-27 /pmc/articles/PMC10677415/ http://dx.doi.org/10.1093/ofid/ofad500.448 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Abstract Ong, Sean W X Daneman, Nick Tong, Steven Y C Naimark, David 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study |
title | 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study |
title_full | 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study |
title_fullStr | 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study |
title_full_unstemmed | 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study |
title_short | 378. Cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study |
title_sort | 378. cost-effectiveness of an adaptive platform trial design compared to sequential conventional clinical trials for comparative drug evaluations in bloodstream infections: a simulation study |
topic | Abstract |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677415/ http://dx.doi.org/10.1093/ofid/ofad500.448 |
work_keys_str_mv | AT ongseanwx 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy AT danemannick 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy AT tongstevenyc 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy AT naimarkdavid 378costeffectivenessofanadaptiveplatformtrialdesigncomparedtosequentialconventionalclinicaltrialsforcomparativedrugevaluationsinbloodstreaminfectionsasimulationstudy |