Cargando…
A survey on how preregistration affects the research workflow: better science but more work
The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvanta...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The Royal Society
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9257590/ https://www.ncbi.nlm.nih.gov/pubmed/35814910 http://dx.doi.org/10.1098/rsos.211997 |
_version_ | 1784741368699027456 |
---|---|
author | Sarafoglou, Alexandra Kovacs, Marton Bakos, Bence Wagenmakers, Eric-Jan Aczel, Balazs |
author_facet | Sarafoglou, Alexandra Kovacs, Marton Bakos, Bence Wagenmakers, Eric-Jan Aczel, Balazs |
author_sort | Sarafoglou, Alexandra |
collection | PubMed |
description | The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvantages of this method remain largely unexplored. The goal of this exploratory study was to identify the perceived benefits and challenges of preregistration from the researcher’s perspective. To this end, we surveyed 355 researchers, 299 of whom had used preregistration in their own work. The researchers indicated the experienced or expected effects of preregistration on their workflow. The results show that experiences and expectations are mostly positive. Researchers in our sample believe that implementing preregistration improves or is likely to improve the quality of their projects. Criticism of preregistration is primarily related to the increase in work-related stress and the overall duration of the project. While the benefits outweighed the challenges for the majority of researchers with preregistration experience, this was not the case for the majority of researchers without preregistration experience. The experienced advantages and disadvantages identified in our survey could inform future efforts to improve preregistration and thus help the methodology gain greater acceptance in the scientific community. |
format | Online Article Text |
id | pubmed-9257590 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | The Royal Society |
record_format | MEDLINE/PubMed |
spelling | pubmed-92575902022-07-09 A survey on how preregistration affects the research workflow: better science but more work Sarafoglou, Alexandra Kovacs, Marton Bakos, Bence Wagenmakers, Eric-Jan Aczel, Balazs R Soc Open Sci Psychology and Cognitive Neuroscience The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvantages of this method remain largely unexplored. The goal of this exploratory study was to identify the perceived benefits and challenges of preregistration from the researcher’s perspective. To this end, we surveyed 355 researchers, 299 of whom had used preregistration in their own work. The researchers indicated the experienced or expected effects of preregistration on their workflow. The results show that experiences and expectations are mostly positive. Researchers in our sample believe that implementing preregistration improves or is likely to improve the quality of their projects. Criticism of preregistration is primarily related to the increase in work-related stress and the overall duration of the project. While the benefits outweighed the challenges for the majority of researchers with preregistration experience, this was not the case for the majority of researchers without preregistration experience. The experienced advantages and disadvantages identified in our survey could inform future efforts to improve preregistration and thus help the methodology gain greater acceptance in the scientific community. The Royal Society 2022-07-06 /pmc/articles/PMC9257590/ /pubmed/35814910 http://dx.doi.org/10.1098/rsos.211997 Text en © 2022 The Authors. https://creativecommons.org/licenses/by/4.0/Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, provided the original author and source are credited. |
spellingShingle | Psychology and Cognitive Neuroscience Sarafoglou, Alexandra Kovacs, Marton Bakos, Bence Wagenmakers, Eric-Jan Aczel, Balazs A survey on how preregistration affects the research workflow: better science but more work |
title | A survey on how preregistration affects the research workflow: better science but more work |
title_full | A survey on how preregistration affects the research workflow: better science but more work |
title_fullStr | A survey on how preregistration affects the research workflow: better science but more work |
title_full_unstemmed | A survey on how preregistration affects the research workflow: better science but more work |
title_short | A survey on how preregistration affects the research workflow: better science but more work |
title_sort | survey on how preregistration affects the research workflow: better science but more work |
topic | Psychology and Cognitive Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9257590/ https://www.ncbi.nlm.nih.gov/pubmed/35814910 http://dx.doi.org/10.1098/rsos.211997 |
work_keys_str_mv | AT sarafogloualexandra asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT kovacsmarton asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT bakosbence asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT wagenmakersericjan asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT aczelbalazs asurveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT sarafogloualexandra surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT kovacsmarton surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT bakosbence surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT wagenmakersericjan surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework AT aczelbalazs surveyonhowpreregistrationaffectstheresearchworkflowbettersciencebutmorework |