Cargando…

Estimating the reproducibility of social learning research published between 1955 and 2018

Reproducibility is integral to science, but difficult to achieve. Previous research has quantified low rates of data availability and results reproducibility across the biological and behavioural sciences. Here, we surveyed 560 empirical publications, published between 1955 and 2018 in the social le...

Descripción completa

Detalles Bibliográficos
Autores principales: Minocher, Riana, Atmaca, Silke, Bavero, Claudia, McElreath, Richard, Beheim, Bret
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Royal Society 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8441137/
https://www.ncbi.nlm.nih.gov/pubmed/34540248
http://dx.doi.org/10.1098/rsos.210450
_version_ 1783752815179464704
author Minocher, Riana
Atmaca, Silke
Bavero, Claudia
McElreath, Richard
Beheim, Bret
author_facet Minocher, Riana
Atmaca, Silke
Bavero, Claudia
McElreath, Richard
Beheim, Bret
author_sort Minocher, Riana
collection PubMed
description Reproducibility is integral to science, but difficult to achieve. Previous research has quantified low rates of data availability and results reproducibility across the biological and behavioural sciences. Here, we surveyed 560 empirical publications, published between 1955 and 2018 in the social learning literature, a research topic that spans animal behaviour, behavioural ecology, cultural evolution and evolutionary psychology. Data were recoverable online or through direct data requests for 30% of this sample. Data recovery declines exponentially with time since publication, halving every 6 years, and up to every 9 years for human experimental data. When data for a publication can be recovered, we estimate a high probability of subsequent data usability (87%), analytical clarity (97%) and agreement of published results with reproduced findings (96%). This corresponds to an overall rate of recovering data and reproducing results of 23%, largely driven by the unavailability or incompleteness of data. We thus outline clear measures to improve the reproducibility of research on the ecology and evolution of social behaviour.
format Online
Article
Text
id pubmed-8441137
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Royal Society
record_format MEDLINE/PubMed
spelling pubmed-84411372021-09-17 Estimating the reproducibility of social learning research published between 1955 and 2018 Minocher, Riana Atmaca, Silke Bavero, Claudia McElreath, Richard Beheim, Bret R Soc Open Sci Organismal and Evolutionary Biology Reproducibility is integral to science, but difficult to achieve. Previous research has quantified low rates of data availability and results reproducibility across the biological and behavioural sciences. Here, we surveyed 560 empirical publications, published between 1955 and 2018 in the social learning literature, a research topic that spans animal behaviour, behavioural ecology, cultural evolution and evolutionary psychology. Data were recoverable online or through direct data requests for 30% of this sample. Data recovery declines exponentially with time since publication, halving every 6 years, and up to every 9 years for human experimental data. When data for a publication can be recovered, we estimate a high probability of subsequent data usability (87%), analytical clarity (97%) and agreement of published results with reproduced findings (96%). This corresponds to an overall rate of recovering data and reproducing results of 23%, largely driven by the unavailability or incompleteness of data. We thus outline clear measures to improve the reproducibility of research on the ecology and evolution of social behaviour. The Royal Society 2021-09-15 /pmc/articles/PMC8441137/ /pubmed/34540248 http://dx.doi.org/10.1098/rsos.210450 Text en © 2021 The Authors. https://creativecommons.org/licenses/by/4.0/Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, provided the original author and source are credited.
spellingShingle Organismal and Evolutionary Biology
Minocher, Riana
Atmaca, Silke
Bavero, Claudia
McElreath, Richard
Beheim, Bret
Estimating the reproducibility of social learning research published between 1955 and 2018
title Estimating the reproducibility of social learning research published between 1955 and 2018
title_full Estimating the reproducibility of social learning research published between 1955 and 2018
title_fullStr Estimating the reproducibility of social learning research published between 1955 and 2018
title_full_unstemmed Estimating the reproducibility of social learning research published between 1955 and 2018
title_short Estimating the reproducibility of social learning research published between 1955 and 2018
title_sort estimating the reproducibility of social learning research published between 1955 and 2018
topic Organismal and Evolutionary Biology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8441137/
https://www.ncbi.nlm.nih.gov/pubmed/34540248
http://dx.doi.org/10.1098/rsos.210450
work_keys_str_mv AT minocherriana estimatingthereproducibilityofsociallearningresearchpublishedbetween1955and2018
AT atmacasilke estimatingthereproducibilityofsociallearningresearchpublishedbetween1955and2018
AT baveroclaudia estimatingthereproducibilityofsociallearningresearchpublishedbetween1955and2018
AT mcelreathrichard estimatingthereproducibilityofsociallearningresearchpublishedbetween1955and2018
AT beheimbret estimatingthereproducibilityofsociallearningresearchpublishedbetween1955and2018