Cargando…

Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011)

Sharing research data allows the scientific community to verify and build upon published work. However, data sharing is not common practice yet. The reasons for not sharing data are myriad: Some are practical, others are more fear-related. One particular fear is that a reanalysis may expose errors....

Descripción completa

Detalles Bibliográficos
Autores principales: Claesen, Aline, Vanpaemel, Wolf, Maerten, Anne-Sofie, Verliefde, Thomas, Tuerlinckx, Francis, Heyman, Tom
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10101414/
https://www.ncbi.nlm.nih.gov/pubmed/37053137
http://dx.doi.org/10.1371/journal.pone.0284243
_version_ 1785025509208358912
author Claesen, Aline
Vanpaemel, Wolf
Maerten, Anne-Sofie
Verliefde, Thomas
Tuerlinckx, Francis
Heyman, Tom
author_facet Claesen, Aline
Vanpaemel, Wolf
Maerten, Anne-Sofie
Verliefde, Thomas
Tuerlinckx, Francis
Heyman, Tom
author_sort Claesen, Aline
collection PubMed
description Sharing research data allows the scientific community to verify and build upon published work. However, data sharing is not common practice yet. The reasons for not sharing data are myriad: Some are practical, others are more fear-related. One particular fear is that a reanalysis may expose errors. For this explanation, it would be interesting to know whether authors that do not share data genuinely made more errors than authors who do share data. (Wicherts, Bakker and Molenaar 2011) examined errors that can be discovered based on the published manuscript only, because it is impossible to reanalyze unavailable data. They found a higher prevalence of such errors in papers for which the data were not shared. However, (Nuijten et al. 2017) did not find support for this finding in three large studies. To shed more light on this relation, we conducted a replication of the study by (Wicherts et al. 2011). Our study consisted of two parts. In the first part, we reproduced the analyses from (Wicherts et al. 2011) to verify the results, and we carried out several alternative analytical approaches to evaluate the robustness of the results against other analytical decisions. In the second part, we used a unique and larger data set that originated from (Vanpaemel et al. 2015) on data sharing upon request for reanalysis, to replicate the findings in (Wicherts et al. 2011). We applied statcheck for the detection of consistency errors in all included papers and manually corrected false positives. Finally, we again assessed the robustness of the replication results against other analytical decisions. Everything taken together, we found no robust empirical evidence for the claim that not sharing research data for reanalysis is associated with consistency errors.
format Online
Article
Text
id pubmed-10101414
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-101014142023-04-14 Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011) Claesen, Aline Vanpaemel, Wolf Maerten, Anne-Sofie Verliefde, Thomas Tuerlinckx, Francis Heyman, Tom PLoS One Research Article Sharing research data allows the scientific community to verify and build upon published work. However, data sharing is not common practice yet. The reasons for not sharing data are myriad: Some are practical, others are more fear-related. One particular fear is that a reanalysis may expose errors. For this explanation, it would be interesting to know whether authors that do not share data genuinely made more errors than authors who do share data. (Wicherts, Bakker and Molenaar 2011) examined errors that can be discovered based on the published manuscript only, because it is impossible to reanalyze unavailable data. They found a higher prevalence of such errors in papers for which the data were not shared. However, (Nuijten et al. 2017) did not find support for this finding in three large studies. To shed more light on this relation, we conducted a replication of the study by (Wicherts et al. 2011). Our study consisted of two parts. In the first part, we reproduced the analyses from (Wicherts et al. 2011) to verify the results, and we carried out several alternative analytical approaches to evaluate the robustness of the results against other analytical decisions. In the second part, we used a unique and larger data set that originated from (Vanpaemel et al. 2015) on data sharing upon request for reanalysis, to replicate the findings in (Wicherts et al. 2011). We applied statcheck for the detection of consistency errors in all included papers and manually corrected false positives. Finally, we again assessed the robustness of the replication results against other analytical decisions. Everything taken together, we found no robust empirical evidence for the claim that not sharing research data for reanalysis is associated with consistency errors. Public Library of Science 2023-04-13 /pmc/articles/PMC10101414/ /pubmed/37053137 http://dx.doi.org/10.1371/journal.pone.0284243 Text en © 2023 Claesen et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Claesen, Aline
Vanpaemel, Wolf
Maerten, Anne-Sofie
Verliefde, Thomas
Tuerlinckx, Francis
Heyman, Tom
Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011)
title Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011)
title_full Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011)
title_fullStr Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011)
title_full_unstemmed Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011)
title_short Data sharing upon request and statistical consistency errors in psychology: A replication of Wicherts, Bakker and Molenaar (2011)
title_sort data sharing upon request and statistical consistency errors in psychology: a replication of wicherts, bakker and molenaar (2011)
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10101414/
https://www.ncbi.nlm.nih.gov/pubmed/37053137
http://dx.doi.org/10.1371/journal.pone.0284243
work_keys_str_mv AT claesenaline datasharinguponrequestandstatisticalconsistencyerrorsinpsychologyareplicationofwichertsbakkerandmolenaar2011
AT vanpaemelwolf datasharinguponrequestandstatisticalconsistencyerrorsinpsychologyareplicationofwichertsbakkerandmolenaar2011
AT maertenannesofie datasharinguponrequestandstatisticalconsistencyerrorsinpsychologyareplicationofwichertsbakkerandmolenaar2011
AT verliefdethomas datasharinguponrequestandstatisticalconsistencyerrorsinpsychologyareplicationofwichertsbakkerandmolenaar2011
AT tuerlinckxfrancis datasharinguponrequestandstatisticalconsistencyerrorsinpsychologyareplicationofwichertsbakkerandmolenaar2011
AT heymantom datasharinguponrequestandstatisticalconsistencyerrorsinpsychologyareplicationofwichertsbakkerandmolenaar2011