Cargando…

The effect of preregistration on trust in empirical research findings: results of a registered report

The crisis of confidence has undermined the trust that researchers place in the findings of their peers. In order to increase trust in research, initiatives such as preregistration have been suggested, which aim to prevent various questionable research practices. As it stands, however, no empirical...

Descripción completa

Detalles Bibliográficos
Autores principales: Field, Sarahanne M., Wagenmakers, E.-J., Kiers, Henk A. L., Hoekstra, Rink, Ernst, Anja F., van Ravenzwaaij, Don
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Royal Society 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7211853/
https://www.ncbi.nlm.nih.gov/pubmed/32431853
http://dx.doi.org/10.1098/rsos.181351
_version_ 1783531526243221504
author Field, Sarahanne M.
Wagenmakers, E.-J.
Kiers, Henk A. L.
Hoekstra, Rink
Ernst, Anja F.
van Ravenzwaaij, Don
author_facet Field, Sarahanne M.
Wagenmakers, E.-J.
Kiers, Henk A. L.
Hoekstra, Rink
Ernst, Anja F.
van Ravenzwaaij, Don
author_sort Field, Sarahanne M.
collection PubMed
description The crisis of confidence has undermined the trust that researchers place in the findings of their peers. In order to increase trust in research, initiatives such as preregistration have been suggested, which aim to prevent various questionable research practices. As it stands, however, no empirical evidence exists that preregistration does increase perceptions of trust. The picture may be complicated by a researcher's familiarity with the author of the study, regardless of the preregistration status of the research. This registered report presents an empirical assessment of the extent to which preregistration increases the trust of 209 active academics in the reported outcomes, and how familiarity with another researcher influences that trust. Contrary to our expectations, we report ambiguous Bayes factors and conclude that we do not have strong evidence towards answering our research questions. Our findings are presented along with evidence that our manipulations were ineffective for many participants, leading to the exclusion of 68% of complete datasets, and an underpowered design as a consequence. We discuss other limitations and confounds which may explain why the findings of the study deviate from a previously conducted pilot study. We reflect on the benefits of using the registered report submission format in light of our results. The OSF page for this registered report and its pilot can be found here: http://dx.doi.org/10.17605/OSF.IO/B3K75.
format Online
Article
Text
id pubmed-7211853
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher The Royal Society
record_format MEDLINE/PubMed
spelling pubmed-72118532020-05-19 The effect of preregistration on trust in empirical research findings: results of a registered report Field, Sarahanne M. Wagenmakers, E.-J. Kiers, Henk A. L. Hoekstra, Rink Ernst, Anja F. van Ravenzwaaij, Don R Soc Open Sci Psychology and Cognitive Neuroscience The crisis of confidence has undermined the trust that researchers place in the findings of their peers. In order to increase trust in research, initiatives such as preregistration have been suggested, which aim to prevent various questionable research practices. As it stands, however, no empirical evidence exists that preregistration does increase perceptions of trust. The picture may be complicated by a researcher's familiarity with the author of the study, regardless of the preregistration status of the research. This registered report presents an empirical assessment of the extent to which preregistration increases the trust of 209 active academics in the reported outcomes, and how familiarity with another researcher influences that trust. Contrary to our expectations, we report ambiguous Bayes factors and conclude that we do not have strong evidence towards answering our research questions. Our findings are presented along with evidence that our manipulations were ineffective for many participants, leading to the exclusion of 68% of complete datasets, and an underpowered design as a consequence. We discuss other limitations and confounds which may explain why the findings of the study deviate from a previously conducted pilot study. We reflect on the benefits of using the registered report submission format in light of our results. The OSF page for this registered report and its pilot can be found here: http://dx.doi.org/10.17605/OSF.IO/B3K75. The Royal Society 2020-04-01 /pmc/articles/PMC7211853/ /pubmed/32431853 http://dx.doi.org/10.1098/rsos.181351 Text en © 2020 The Authors. http://creativecommons.org/licenses/by/4.0/ http://creativecommons.org/licenses/by/4.0/http://creativecommons.org/licenses/by/4.0/Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited.
spellingShingle Psychology and Cognitive Neuroscience
Field, Sarahanne M.
Wagenmakers, E.-J.
Kiers, Henk A. L.
Hoekstra, Rink
Ernst, Anja F.
van Ravenzwaaij, Don
The effect of preregistration on trust in empirical research findings: results of a registered report
title The effect of preregistration on trust in empirical research findings: results of a registered report
title_full The effect of preregistration on trust in empirical research findings: results of a registered report
title_fullStr The effect of preregistration on trust in empirical research findings: results of a registered report
title_full_unstemmed The effect of preregistration on trust in empirical research findings: results of a registered report
title_short The effect of preregistration on trust in empirical research findings: results of a registered report
title_sort effect of preregistration on trust in empirical research findings: results of a registered report
topic Psychology and Cognitive Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7211853/
https://www.ncbi.nlm.nih.gov/pubmed/32431853
http://dx.doi.org/10.1098/rsos.181351
work_keys_str_mv AT fieldsarahannem theeffectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT wagenmakersej theeffectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT kiershenkal theeffectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT hoekstrarink theeffectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT ernstanjaf theeffectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT vanravenzwaaijdon theeffectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT fieldsarahannem effectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT wagenmakersej effectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT kiershenkal effectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT hoekstrarink effectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT ernstanjaf effectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport
AT vanravenzwaaijdon effectofpreregistrationontrustinempiricalresearchfindingsresultsofaregisteredreport