Cargando…

Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study

BACKGROUND: Methodological rigor is a major priority in preclinical cardiovascular research to ensure experimental reproducibility and high quality research. Lack of reproducibility results in diminished translation of preclinical discoveries into medical practice and wastes resources. In addition,...

Descripción completa

Detalles Bibliográficos
Autores principales: Jimenez, Isaiah C., Montenegro, Gabrielle C., Zahiri, Keyana, Patel, Damini, Mueller, Adrienne
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327086/
https://www.ncbi.nlm.nih.gov/pubmed/37425725
http://dx.doi.org/10.1101/2023.06.27.546731
_version_ 1785069555058475008
author Jimenez, Isaiah C.
Montenegro, Gabrielle C.
Zahiri, Keyana
Patel, Damini
Mueller, Adrienne
author_facet Jimenez, Isaiah C.
Montenegro, Gabrielle C.
Zahiri, Keyana
Patel, Damini
Mueller, Adrienne
author_sort Jimenez, Isaiah C.
collection PubMed
description BACKGROUND: Methodological rigor is a major priority in preclinical cardiovascular research to ensure experimental reproducibility and high quality research. Lack of reproducibility results in diminished translation of preclinical discoveries into medical practice and wastes resources. In addition, lack of reproducibility fosters uncertainty in the public’s acceptance of reported research results. METHODS: We evaluate the reporting of rigorous methodological practices in preclinical cardiovascular research studies published in leading scientific journals by screening articles for the inclusion of the following key study design elements (SDEs): considering sex as a biological variable, randomization, blinding, and sample size power estimation. We have specifically chosen to screen for these SDEs across articles pertaining to preclinical cardiovascular research studies published between 2011 and 2021. Our study replicates and extends a study published in 2017 by Ramirez et al. We hypothesized that there would be higher SDE inclusion across preclinical studies over time, that preclinical studies that also include human and animal substudies within the same study will exhibit greater SDE inclusion than animal-only preclinical studies, and that there will be a difference in SDE usage between large and small animal models. RESULTS: Overall, inclusion of SDEs was low. 15.2% of animal only studies included both sexes as a biological variable, 30.4% included randomization, 32.1% included blinding, and 8.2% included sample size estimation. Incorporation of SDE in preclinical studies did not significantly increase over the ten year time period in the articles we assessed. Although the inclusion of sex as a biological variable increased over the 10 year time frame, that change was not significant (p=0.411, corrected p=8.22). These trends were consistent across journals. Reporting of randomization and sample size estimation differs significantly between animal and human substudies (corrected p=3.690e-06 and corrected p=7.252e-08, respectively.) Large animal studies had a significantly greater percentage of blinding reported when compared to small animal studies (corrected p=0.01.) Additionally, overall, large animal studies tended to have higher SDE usage. CONCLUSIONS: In summary, evidence of methodological rigor varies substantially depending on the study type and model organisms used. Over the time period of 2011–2021, the reporting of SDEs within preclinical cardiovascular studies has not improved and suggests extensive evaluation of other SDEs used in cardiovascular research. Limited incorporation of SDEs within research hinders experimental reproducibility that is critical to future research.
format Online
Article
Text
id pubmed-10327086
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-103270862023-07-08 Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study Jimenez, Isaiah C. Montenegro, Gabrielle C. Zahiri, Keyana Patel, Damini Mueller, Adrienne bioRxiv Article BACKGROUND: Methodological rigor is a major priority in preclinical cardiovascular research to ensure experimental reproducibility and high quality research. Lack of reproducibility results in diminished translation of preclinical discoveries into medical practice and wastes resources. In addition, lack of reproducibility fosters uncertainty in the public’s acceptance of reported research results. METHODS: We evaluate the reporting of rigorous methodological practices in preclinical cardiovascular research studies published in leading scientific journals by screening articles for the inclusion of the following key study design elements (SDEs): considering sex as a biological variable, randomization, blinding, and sample size power estimation. We have specifically chosen to screen for these SDEs across articles pertaining to preclinical cardiovascular research studies published between 2011 and 2021. Our study replicates and extends a study published in 2017 by Ramirez et al. We hypothesized that there would be higher SDE inclusion across preclinical studies over time, that preclinical studies that also include human and animal substudies within the same study will exhibit greater SDE inclusion than animal-only preclinical studies, and that there will be a difference in SDE usage between large and small animal models. RESULTS: Overall, inclusion of SDEs was low. 15.2% of animal only studies included both sexes as a biological variable, 30.4% included randomization, 32.1% included blinding, and 8.2% included sample size estimation. Incorporation of SDE in preclinical studies did not significantly increase over the ten year time period in the articles we assessed. Although the inclusion of sex as a biological variable increased over the 10 year time frame, that change was not significant (p=0.411, corrected p=8.22). These trends were consistent across journals. Reporting of randomization and sample size estimation differs significantly between animal and human substudies (corrected p=3.690e-06 and corrected p=7.252e-08, respectively.) Large animal studies had a significantly greater percentage of blinding reported when compared to small animal studies (corrected p=0.01.) Additionally, overall, large animal studies tended to have higher SDE usage. CONCLUSIONS: In summary, evidence of methodological rigor varies substantially depending on the study type and model organisms used. Over the time period of 2011–2021, the reporting of SDEs within preclinical cardiovascular studies has not improved and suggests extensive evaluation of other SDEs used in cardiovascular research. Limited incorporation of SDEs within research hinders experimental reproducibility that is critical to future research. Cold Spring Harbor Laboratory 2023-06-29 /pmc/articles/PMC10327086/ /pubmed/37425725 http://dx.doi.org/10.1101/2023.06.27.546731 Text en https://creativecommons.org/licenses/by/4.0/This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/) , which allows reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
spellingShingle Article
Jimenez, Isaiah C.
Montenegro, Gabrielle C.
Zahiri, Keyana
Patel, Damini
Mueller, Adrienne
Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study
title Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study
title_full Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study
title_fullStr Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study
title_full_unstemmed Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study
title_short Evaluating Study Design Rigor in Preclinical Cardiovascular Research: A Replication Study
title_sort evaluating study design rigor in preclinical cardiovascular research: a replication study
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327086/
https://www.ncbi.nlm.nih.gov/pubmed/37425725
http://dx.doi.org/10.1101/2023.06.27.546731
work_keys_str_mv AT jimenezisaiahc evaluatingstudydesignrigorinpreclinicalcardiovascularresearchareplicationstudy
AT montenegrogabriellec evaluatingstudydesignrigorinpreclinicalcardiovascularresearchareplicationstudy
AT zahirikeyana evaluatingstudydesignrigorinpreclinicalcardiovascularresearchareplicationstudy
AT pateldamini evaluatingstudydesignrigorinpreclinicalcardiovascularresearchareplicationstudy
AT muelleradrienne evaluatingstudydesignrigorinpreclinicalcardiovascularresearchareplicationstudy