Cargando…

Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials

IMPORTANCE: Numerous studies have shown that adherence to reporting guidelines is suboptimal. OBJECTIVE: To evaluate whether asking peer reviewers to check if specific reporting guideline items were adequately reported would improve adherence to reporting guidelines in published articles. DESIGN, SE...

Descripción completa

Detalles Bibliográficos
Autores principales: Speich, Benjamin, Mann, Erika, Schönenberger, Christof M., Mellor, Katie, Griessbach, Alexandra N., Dhiman, Paula, Gandhi, Pooja, Lohner, Szimonetta, Agarwal, Arnav, Odutayo, Ayodele, Puebla, Iratxe, Clark, Alejandra, Chan, An-Wen, Schlussel, Michael M., Ravaud, Philippe, Moher, David, Briel, Matthias, Boutron, Isabelle, Schroter, Sara, Hopewell, Sally
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Medical Association 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10257091/
https://www.ncbi.nlm.nih.gov/pubmed/37294569
http://dx.doi.org/10.1001/jamanetworkopen.2023.17651
_version_ 1785057237994045440
author Speich, Benjamin
Mann, Erika
Schönenberger, Christof M.
Mellor, Katie
Griessbach, Alexandra N.
Dhiman, Paula
Gandhi, Pooja
Lohner, Szimonetta
Agarwal, Arnav
Odutayo, Ayodele
Puebla, Iratxe
Clark, Alejandra
Chan, An-Wen
Schlussel, Michael M.
Ravaud, Philippe
Moher, David
Briel, Matthias
Boutron, Isabelle
Schroter, Sara
Hopewell, Sally
author_facet Speich, Benjamin
Mann, Erika
Schönenberger, Christof M.
Mellor, Katie
Griessbach, Alexandra N.
Dhiman, Paula
Gandhi, Pooja
Lohner, Szimonetta
Agarwal, Arnav
Odutayo, Ayodele
Puebla, Iratxe
Clark, Alejandra
Chan, An-Wen
Schlussel, Michael M.
Ravaud, Philippe
Moher, David
Briel, Matthias
Boutron, Isabelle
Schroter, Sara
Hopewell, Sally
author_sort Speich, Benjamin
collection PubMed
description IMPORTANCE: Numerous studies have shown that adherence to reporting guidelines is suboptimal. OBJECTIVE: To evaluate whether asking peer reviewers to check if specific reporting guideline items were adequately reported would improve adherence to reporting guidelines in published articles. DESIGN, SETTING, AND PARTICIPANTS: Two parallel-group, superiority randomized trials were performed using manuscripts submitted to 7 biomedical journals (5 from the BMJ Publishing Group and 2 from the Public Library of Science) as the unit of randomization, with peer reviewers allocated to the intervention or control group. INTERVENTIONS: The first trial (CONSORT-PR) focused on manuscripts that presented randomized clinical trial (RCT) results and reported following the Consolidated Standards of Reporting Trials (CONSORT) guideline, and the second trial (SPIRIT-PR) focused on manuscripts that presented RCT protocols and reported following the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline. The CONSORT-PR trial included manuscripts that described RCT primary results (submitted July 2019 to July 2021). The SPIRIT-PR trial included manuscripts that contained RCT protocols (submitted June 2020 to May 2021). Manuscripts in both trials were randomized (1:1) to the intervention or control group; the control group received usual journal practice. In the intervention group of both trials, peer reviewers received an email from the journal that asked them to check whether the 10 most important and poorly reported CONSORT (for CONSORT-PR) or SPIRIT (for SPIRIT-PR) items were adequately reported in the manuscript. Peer reviewers and authors were not informed of the purpose of the study, and outcome assessors were blinded. MAIN OUTCOMES AND MEASURES: The difference in the mean proportion of adequately reported 10 CONSORT or SPIRIT items between the intervention and control groups in published articles. RESULTS: In the CONSORT-PR trial, 510 manuscripts were randomized. Of those, 243 were published (122 in the intervention group and 121 in the control group). A mean proportion of 69.3% (95% CI, 66.0%-72.7%) of the 10 CONSORT items were adequately reported in the intervention group and 66.6% (95% CI, 62.5%-70.7%) in the control group (mean difference, 2.7%; 95% CI, −2.6% to 8.0%). In the SPIRIT-PR trial, of the 244 randomized manuscripts, 178 were published (90 in the intervention group and 88 in the control group). A mean proportion of 46.1% (95% CI, 41.8%-50.4%) of the 10 SPIRIT items were adequately reported in the intervention group and 45.6% (95% CI, 41.7% to 49.4%) in the control group (mean difference, 0.5%; 95% CI, −5.2% to 6.3%). CONCLUSIONS AND RELEVANCE: These 2 randomized trials found that it was not useful to implement the tested intervention to increase reporting completeness in published articles. Other interventions should be assessed and considered in the future. TRIAL REGISTRATION: ClinicalTrials.gov Identifiers: NCT05820971 (CONSORT-PR) and NCT05820984 (SPIRIT-PR)
format Online
Article
Text
id pubmed-10257091
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher American Medical Association
record_format MEDLINE/PubMed
spelling pubmed-102570912023-06-11 Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials Speich, Benjamin Mann, Erika Schönenberger, Christof M. Mellor, Katie Griessbach, Alexandra N. Dhiman, Paula Gandhi, Pooja Lohner, Szimonetta Agarwal, Arnav Odutayo, Ayodele Puebla, Iratxe Clark, Alejandra Chan, An-Wen Schlussel, Michael M. Ravaud, Philippe Moher, David Briel, Matthias Boutron, Isabelle Schroter, Sara Hopewell, Sally JAMA Netw Open Original Investigation IMPORTANCE: Numerous studies have shown that adherence to reporting guidelines is suboptimal. OBJECTIVE: To evaluate whether asking peer reviewers to check if specific reporting guideline items were adequately reported would improve adherence to reporting guidelines in published articles. DESIGN, SETTING, AND PARTICIPANTS: Two parallel-group, superiority randomized trials were performed using manuscripts submitted to 7 biomedical journals (5 from the BMJ Publishing Group and 2 from the Public Library of Science) as the unit of randomization, with peer reviewers allocated to the intervention or control group. INTERVENTIONS: The first trial (CONSORT-PR) focused on manuscripts that presented randomized clinical trial (RCT) results and reported following the Consolidated Standards of Reporting Trials (CONSORT) guideline, and the second trial (SPIRIT-PR) focused on manuscripts that presented RCT protocols and reported following the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline. The CONSORT-PR trial included manuscripts that described RCT primary results (submitted July 2019 to July 2021). The SPIRIT-PR trial included manuscripts that contained RCT protocols (submitted June 2020 to May 2021). Manuscripts in both trials were randomized (1:1) to the intervention or control group; the control group received usual journal practice. In the intervention group of both trials, peer reviewers received an email from the journal that asked them to check whether the 10 most important and poorly reported CONSORT (for CONSORT-PR) or SPIRIT (for SPIRIT-PR) items were adequately reported in the manuscript. Peer reviewers and authors were not informed of the purpose of the study, and outcome assessors were blinded. MAIN OUTCOMES AND MEASURES: The difference in the mean proportion of adequately reported 10 CONSORT or SPIRIT items between the intervention and control groups in published articles. RESULTS: In the CONSORT-PR trial, 510 manuscripts were randomized. Of those, 243 were published (122 in the intervention group and 121 in the control group). A mean proportion of 69.3% (95% CI, 66.0%-72.7%) of the 10 CONSORT items were adequately reported in the intervention group and 66.6% (95% CI, 62.5%-70.7%) in the control group (mean difference, 2.7%; 95% CI, −2.6% to 8.0%). In the SPIRIT-PR trial, of the 244 randomized manuscripts, 178 were published (90 in the intervention group and 88 in the control group). A mean proportion of 46.1% (95% CI, 41.8%-50.4%) of the 10 SPIRIT items were adequately reported in the intervention group and 45.6% (95% CI, 41.7% to 49.4%) in the control group (mean difference, 0.5%; 95% CI, −5.2% to 6.3%). CONCLUSIONS AND RELEVANCE: These 2 randomized trials found that it was not useful to implement the tested intervention to increase reporting completeness in published articles. Other interventions should be assessed and considered in the future. TRIAL REGISTRATION: ClinicalTrials.gov Identifiers: NCT05820971 (CONSORT-PR) and NCT05820984 (SPIRIT-PR) American Medical Association 2023-06-09 /pmc/articles/PMC10257091/ /pubmed/37294569 http://dx.doi.org/10.1001/jamanetworkopen.2023.17651 Text en Copyright 2023 Speich B et al. JAMA Network Open. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the CC-BY License.
spellingShingle Original Investigation
Speich, Benjamin
Mann, Erika
Schönenberger, Christof M.
Mellor, Katie
Griessbach, Alexandra N.
Dhiman, Paula
Gandhi, Pooja
Lohner, Szimonetta
Agarwal, Arnav
Odutayo, Ayodele
Puebla, Iratxe
Clark, Alejandra
Chan, An-Wen
Schlussel, Michael M.
Ravaud, Philippe
Moher, David
Briel, Matthias
Boutron, Isabelle
Schroter, Sara
Hopewell, Sally
Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials
title Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials
title_full Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials
title_fullStr Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials
title_full_unstemmed Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials
title_short Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials
title_sort reminding peer reviewers of reporting guideline items to improve completeness in published articles: primary results of 2 randomized trials
topic Original Investigation
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10257091/
https://www.ncbi.nlm.nih.gov/pubmed/37294569
http://dx.doi.org/10.1001/jamanetworkopen.2023.17651
work_keys_str_mv AT speichbenjamin remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT mannerika remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT schonenbergerchristofm remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT mellorkatie remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT griessbachalexandran remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT dhimanpaula remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT gandhipooja remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT lohnerszimonetta remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT agarwalarnav remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT odutayoayodele remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT pueblairatxe remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT clarkalejandra remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT chananwen remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT schlusselmichaelm remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT ravaudphilippe remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT moherdavid remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT brielmatthias remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT boutronisabelle remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT schrotersara remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials
AT hopewellsally remindingpeerreviewersofreportingguidelineitemstoimprovecompletenessinpublishedarticlesprimaryresultsof2randomizedtrials