Cargando…

A survey on how preregistration affects the research workflow: better science but more work

The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvanta...

Descripción completa

Detalles Bibliográficos
Autores principales: Sarafoglou, Alexandra, Kovacs, Marton, Bakos, Bence, Wagenmakers, Eric-Jan, Aczel, Balazs
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Royal Society 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9257590/
https://www.ncbi.nlm.nih.gov/pubmed/35814910
http://dx.doi.org/10.1098/rsos.211997
_version_ 1784741368699027456
author Sarafoglou, Alexandra
Kovacs, Marton
Bakos, Bence
Wagenmakers, Eric-Jan
Aczel, Balazs
author_facet Sarafoglou, Alexandra
Kovacs, Marton
Bakos, Bence
Wagenmakers, Eric-Jan
Aczel, Balazs
author_sort Sarafoglou, Alexandra
collection PubMed
description The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvantages of this method remain largely unexplored. The goal of this exploratory study was to identify the perceived benefits and challenges of preregistration from the researcher’s perspective. To this end, we surveyed 355 researchers, 299 of whom had used preregistration in their own work. The researchers indicated the experienced or expected effects of preregistration on their workflow. The results show that experiences and expectations are mostly positive. Researchers in our sample believe that implementing preregistration improves or is likely to improve the quality of their projects. Criticism of preregistration is primarily related to the increase in work-related stress and the overall duration of the project. While the benefits outweighed the challenges for the majority of researchers with preregistration experience, this was not the case for the majority of researchers without preregistration experience. The experienced advantages and disadvantages identified in our survey could inform future efforts to improve preregistration and thus help the methodology gain greater acceptance in the scientific community.
format Online
Article
Text
id pubmed-9257590
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher The Royal Society
record_format MEDLINE/PubMed
spelling pubmed-92575902022-07-09 A survey on how preregistration affects the research workflow: better science but more work Sarafoglou, Alexandra Kovacs, Marton Bakos, Bence Wagenmakers, Eric-Jan Aczel, Balazs R Soc Open Sci Psychology and Cognitive Neuroscience The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvantages of this method remain largely unexplored. The goal of this exploratory study was to identify the perceived benefits and challenges of preregistration from the researcher’s perspective. To this end, we surveyed 355 researchers, 299 of whom had used preregistration in their own work. The researchers indicated the experienced or expected effects of preregistration on their workflow. The results show that experiences and expectations are mostly positive. Researchers in our sample believe that implementing preregistration improves or is likely to improve the quality of their projects. Criticism of preregistration is primarily related to the increase in work-related stress and the overall duration of the project. While the benefits outweighed the challenges for the majority of researchers with preregistration experience, this was not the case for the majority of researchers without preregistration experience. The experienced advantages and disadvantages identified in our survey could inform future efforts to improve preregistration and thus help the methodology gain greater acceptance in the scientific community. The Royal Society 2022-07-06 /pmc/articles/PMC9257590/ /pubmed/35814910 http://dx.doi.org/10.1098/rsos.211997 Text en © 2022 The Authors. https://creativecommons.org/licenses/by/4.0/Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, provided the original author and source are credited.
spellingShingle Psychology and Cognitive Neuroscience
Sarafoglou, Alexandra
Kovacs, Marton
Bakos, Bence
Wagenmakers, Eric-Jan
Aczel, Balazs
A survey on how preregistration affects the research workflow: better science but more work
title A survey on how preregistration affects the research workflow: better science but more work
title_full A survey on how preregistration affects the research workflow: better science but more work
title_fullStr A survey on how preregistration affects the research workflow: better science but more work
title_full_unstemmed A survey on how preregistration affects the research workflow: better science but more work
title_short A survey on how preregistration affects the research workflow: better science but more work
title_sort survey on how preregistration affects the research workflow: better science but more work
topic Psychology and Cognitive Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9257590/
https://www.ncbi.nlm.nih.gov/pubmed/35814910
http://dx.doi.org/10.1098/rsos.211997
work_keys_str_mv AT sarafogloualexandra asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT kovacsmarton asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT bakosbence asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT wagenmakersericjan asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT aczelbalazs asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT sarafogloualexandra surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT kovacsmarton surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT bakosbence surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT wagenmakersericjan surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework
AT aczelbalazs surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework