Cargando…

Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review

IMPORTANCE: Group sequential designs allow potential early trial termination at the interim analysis, before study completion. Traditional maximum likelihood estimate is commonly used to quantify the treatment effect in group sequential design trials; however, in published clinical trials, a bias-ad...

Descripción completa

Detalles Bibliográficos
Autores principales: Shimura, Masashi, Nomura, Shogo, Wakabayashi, Masashi, Maruo, Kazushi, Gosho, Masahiko
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Medical Association 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7312398/
https://www.ncbi.nlm.nih.gov/pubmed/32573709
http://dx.doi.org/10.1001/jamanetworkopen.2020.8633
_version_ 1783549718943498240
author Shimura, Masashi
Nomura, Shogo
Wakabayashi, Masashi
Maruo, Kazushi
Gosho, Masahiko
author_facet Shimura, Masashi
Nomura, Shogo
Wakabayashi, Masashi
Maruo, Kazushi
Gosho, Masahiko
author_sort Shimura, Masashi
collection PubMed
description IMPORTANCE: Group sequential designs allow potential early trial termination at the interim analysis, before study completion. Traditional maximum likelihood estimate is commonly used to quantify the treatment effect in group sequential design trials; however, in published clinical trials, a bias-adjusted estimator has rarely been reported. OBJECTIVE: To emphasize the need for considering overestimation of treatment effect by applying 2 bias-adjusted estimators to previously published, early-terminated oncology clinical trials. EVIDENCE REVIEW: Trials published from 2013 to 2017 were identified by searching MEDLINE and Embase on February 23, 2018. This review was restricted to oncology clinical trials using group sequential designs with a single preplanned interim analysis as well as 2-arm randomized clinical trials that were subsequently stopped for efficacy reasons. Each article was independently reviewed by 3 biostatisticians during text screening, and differences in opinion were resolved by discussion. This report presents the unadjusted hazard ratio (HR) of an experimental arm to a reference arm and 2 bias-adjusted HRs calculated by using the conditional mean-adjusted estimator (CMAE) and weighted CMAE (WCMAE). FINDINGS: In total, 198 abstracts were screened for eligibility, of which, 19 eligible clinical trials were identified as applicable to the bias-adjusted estimators. Unadjusted HRs ranged from 0.203 (95% CI, 0.150-0.276) to 0.71 (95% CI, 0.60-0.84), number of events at the interim analysis from 58 to 540, and information time from 48% to 82%. In each study, the HRs adjusted by CMAE and WCMAE were higher than the unadjusted HR. Bias-adjusted estimates in large trials (243 and 414 events at the interim analysis) were similar to the unadjusted HR. However, in small trials (eg, with 58 events at the interim analysis), bias-adjusted estimates were highly disparate from the unadjusted HR. In trials with large treatment effects (eg, HRs of 0.20 and 0.22), the difference between unadjusted and bias-adjusted HRs was small even though the number of events at the interim analysis was small; larger differences were observed when the unadjusted HR was greater than 0.5. CONCLUSIONS AND RELEVANCE: In this systematic review of oncology clinical trials that were stopped for efficacy at the interim analysis, relatively large differences were noted between the unadjusted and adjusted HRs when the number of events at the interim analysis was small or when the unadjusted HR was close to the boundaries. These findings suggest presenting the 2 bias-adjusted HRs along with the unadjusted HR in the data monitoring committee meeting.
format Online
Article
Text
id pubmed-7312398
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher American Medical Association
record_format MEDLINE/PubMed
spelling pubmed-73123982020-06-26 Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review Shimura, Masashi Nomura, Shogo Wakabayashi, Masashi Maruo, Kazushi Gosho, Masahiko JAMA Netw Open Original Investigation IMPORTANCE: Group sequential designs allow potential early trial termination at the interim analysis, before study completion. Traditional maximum likelihood estimate is commonly used to quantify the treatment effect in group sequential design trials; however, in published clinical trials, a bias-adjusted estimator has rarely been reported. OBJECTIVE: To emphasize the need for considering overestimation of treatment effect by applying 2 bias-adjusted estimators to previously published, early-terminated oncology clinical trials. EVIDENCE REVIEW: Trials published from 2013 to 2017 were identified by searching MEDLINE and Embase on February 23, 2018. This review was restricted to oncology clinical trials using group sequential designs with a single preplanned interim analysis as well as 2-arm randomized clinical trials that were subsequently stopped for efficacy reasons. Each article was independently reviewed by 3 biostatisticians during text screening, and differences in opinion were resolved by discussion. This report presents the unadjusted hazard ratio (HR) of an experimental arm to a reference arm and 2 bias-adjusted HRs calculated by using the conditional mean-adjusted estimator (CMAE) and weighted CMAE (WCMAE). FINDINGS: In total, 198 abstracts were screened for eligibility, of which, 19 eligible clinical trials were identified as applicable to the bias-adjusted estimators. Unadjusted HRs ranged from 0.203 (95% CI, 0.150-0.276) to 0.71 (95% CI, 0.60-0.84), number of events at the interim analysis from 58 to 540, and information time from 48% to 82%. In each study, the HRs adjusted by CMAE and WCMAE were higher than the unadjusted HR. Bias-adjusted estimates in large trials (243 and 414 events at the interim analysis) were similar to the unadjusted HR. However, in small trials (eg, with 58 events at the interim analysis), bias-adjusted estimates were highly disparate from the unadjusted HR. In trials with large treatment effects (eg, HRs of 0.20 and 0.22), the difference between unadjusted and bias-adjusted HRs was small even though the number of events at the interim analysis was small; larger differences were observed when the unadjusted HR was greater than 0.5. CONCLUSIONS AND RELEVANCE: In this systematic review of oncology clinical trials that were stopped for efficacy at the interim analysis, relatively large differences were noted between the unadjusted and adjusted HRs when the number of events at the interim analysis was small or when the unadjusted HR was close to the boundaries. These findings suggest presenting the 2 bias-adjusted HRs along with the unadjusted HR in the data monitoring committee meeting. American Medical Association 2020-06-23 /pmc/articles/PMC7312398/ /pubmed/32573709 http://dx.doi.org/10.1001/jamanetworkopen.2020.8633 Text en Copyright 2020 Shimura M et al. JAMA Network Open. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article distributed under the terms of the CC-BY-NC-ND License.
spellingShingle Original Investigation
Shimura, Masashi
Nomura, Shogo
Wakabayashi, Masashi
Maruo, Kazushi
Gosho, Masahiko
Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review
title Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review
title_full Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review
title_fullStr Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review
title_full_unstemmed Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review
title_short Assessment of Hazard Ratios in Oncology Clinical Trials Terminated Early for Superiority: A Systematic Review
title_sort assessment of hazard ratios in oncology clinical trials terminated early for superiority: a systematic review
topic Original Investigation
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7312398/
https://www.ncbi.nlm.nih.gov/pubmed/32573709
http://dx.doi.org/10.1001/jamanetworkopen.2020.8633
work_keys_str_mv AT shimuramasashi assessmentofhazardratiosinoncologyclinicaltrialsterminatedearlyforsuperiorityasystematicreview
AT nomurashogo assessmentofhazardratiosinoncologyclinicaltrialsterminatedearlyforsuperiorityasystematicreview
AT wakabayashimasashi assessmentofhazardratiosinoncologyclinicaltrialsterminatedearlyforsuperiorityasystematicreview
AT maruokazushi assessmentofhazardratiosinoncologyclinicaltrialsterminatedearlyforsuperiorityasystematicreview
AT goshomasahiko assessmentofhazardratiosinoncologyclinicaltrialsterminatedearlyforsuperiorityasystematicreview