Cargando…

The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later

Changes in statistical practices and reporting have been documented by Giofrè et al. PLOS ONE 12(4), e0175583 (2017), who investigated ten statistical and open practices in two high-ranking journals (Psychological Science [PS] and Journal of Experimental Psychology-General [JEPG]): null hypothesis s...

Descripción completa

Detalles Bibliográficos
Autores principales: Giofrè, David, Boedker, Ingrid, Cumming, Geoff, Rivella, Carlotta, Tressoldi, Patrizio
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10615932/
https://www.ncbi.nlm.nih.gov/pubmed/36253598
http://dx.doi.org/10.3758/s13428-022-01993-3
_version_ 1785129289163735040
author Giofrè, David
Boedker, Ingrid
Cumming, Geoff
Rivella, Carlotta
Tressoldi, Patrizio
author_facet Giofrè, David
Boedker, Ingrid
Cumming, Geoff
Rivella, Carlotta
Tressoldi, Patrizio
author_sort Giofrè, David
collection PubMed
description Changes in statistical practices and reporting have been documented by Giofrè et al. PLOS ONE 12(4), e0175583 (2017), who investigated ten statistical and open practices in two high-ranking journals (Psychological Science [PS] and Journal of Experimental Psychology-General [JEPG]): null hypothesis significance testing; confidence or credible intervals; meta-analysis of the results of multiple experiments; confidence interval interpretation; effect size interpretation; sample size determination; data exclusion; data availability; materials availability; and preregistered design and analysis plan. The investigation was based on an analysis of all papers published in these journals between 2013 and 2015. The aim of the present study was to follow up changes in both PS and JEPG in subsequent years, from 2016 to 2020, adding code availability as a further open practice. We found improvement in most practices, with some exceptions (i.e., confidence interval interpretation and meta-analysis). Despite these positive changes, our results indicate a need for further improvements in statistical practices and adoption of open practices. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.3758/s13428-022-01993-3.
format Online
Article
Text
id pubmed-10615932
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-106159322023-11-01 The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later Giofrè, David Boedker, Ingrid Cumming, Geoff Rivella, Carlotta Tressoldi, Patrizio Behav Res Methods Article Changes in statistical practices and reporting have been documented by Giofrè et al. PLOS ONE 12(4), e0175583 (2017), who investigated ten statistical and open practices in two high-ranking journals (Psychological Science [PS] and Journal of Experimental Psychology-General [JEPG]): null hypothesis significance testing; confidence or credible intervals; meta-analysis of the results of multiple experiments; confidence interval interpretation; effect size interpretation; sample size determination; data exclusion; data availability; materials availability; and preregistered design and analysis plan. The investigation was based on an analysis of all papers published in these journals between 2013 and 2015. The aim of the present study was to follow up changes in both PS and JEPG in subsequent years, from 2016 to 2020, adding code availability as a further open practice. We found improvement in most practices, with some exceptions (i.e., confidence interval interpretation and meta-analysis). Despite these positive changes, our results indicate a need for further improvements in statistical practices and adoption of open practices. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.3758/s13428-022-01993-3. Springer US 2022-10-17 2023 /pmc/articles/PMC10615932/ /pubmed/36253598 http://dx.doi.org/10.3758/s13428-022-01993-3 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Giofrè, David
Boedker, Ingrid
Cumming, Geoff
Rivella, Carlotta
Tressoldi, Patrizio
The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later
title The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later
title_full The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later
title_fullStr The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later
title_full_unstemmed The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later
title_short The influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: Five years later
title_sort influence of journal submission guidelines on authors’ reporting of statistics and use of open research practices: five years later
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10615932/
https://www.ncbi.nlm.nih.gov/pubmed/36253598
http://dx.doi.org/10.3758/s13428-022-01993-3
work_keys_str_mv AT giofredavid theinfluenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT boedkeringrid theinfluenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT cumminggeoff theinfluenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT rivellacarlotta theinfluenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT tressoldipatrizio theinfluenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT giofredavid influenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT boedkeringrid influenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT cumminggeoff influenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT rivellacarlotta influenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater
AT tressoldipatrizio influenceofjournalsubmissionguidelinesonauthorsreportingofstatisticsanduseofopenresearchpracticesfiveyearslater