Cargando…

Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions

We can regard the wider incentive structures that operate across science, such as the priority given to novel findings, as an ecosystem within which scientists strive to maximise their fitness (i.e., publication record and career success). Here, we develop an optimality model that predicts the most...

Descripción completa

Detalles Bibliográficos
Autores principales: Higginson, Andrew D., Munafò, Marcus R.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5104444/
https://www.ncbi.nlm.nih.gov/pubmed/27832072
http://dx.doi.org/10.1371/journal.pbio.2000995
_version_ 1782466749313056768
author Higginson, Andrew D.
Munafò, Marcus R.
author_facet Higginson, Andrew D.
Munafò, Marcus R.
author_sort Higginson, Andrew D.
collection PubMed
description We can regard the wider incentive structures that operate across science, such as the priority given to novel findings, as an ecosystem within which scientists strive to maximise their fitness (i.e., publication record and career success). Here, we develop an optimality model that predicts the most rational research strategy, in terms of the proportion of research effort spent on seeking novel results rather than on confirmatory studies, and the amount of research effort per exploratory study. We show that, for parameter values derived from the scientific literature, researchers acting to maximise their fitness should spend most of their effort seeking novel results and conduct small studies that have only 10%–40% statistical power. As a result, half of the studies they publish will report erroneous conclusions. Current incentive structures are in conflict with maximising the scientific value of research; we suggest ways that the scientific ecosystem could be improved.
format Online
Article
Text
id pubmed-5104444
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-51044442016-12-08 Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions Higginson, Andrew D. Munafò, Marcus R. PLoS Biol Perspective We can regard the wider incentive structures that operate across science, such as the priority given to novel findings, as an ecosystem within which scientists strive to maximise their fitness (i.e., publication record and career success). Here, we develop an optimality model that predicts the most rational research strategy, in terms of the proportion of research effort spent on seeking novel results rather than on confirmatory studies, and the amount of research effort per exploratory study. We show that, for parameter values derived from the scientific literature, researchers acting to maximise their fitness should spend most of their effort seeking novel results and conduct small studies that have only 10%–40% statistical power. As a result, half of the studies they publish will report erroneous conclusions. Current incentive structures are in conflict with maximising the scientific value of research; we suggest ways that the scientific ecosystem could be improved. Public Library of Science 2016-11-10 /pmc/articles/PMC5104444/ /pubmed/27832072 http://dx.doi.org/10.1371/journal.pbio.2000995 Text en © 2016 Higginson, Munafò http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Perspective
Higginson, Andrew D.
Munafò, Marcus R.
Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions
title Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions
title_full Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions
title_fullStr Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions
title_full_unstemmed Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions
title_short Current Incentives for Scientists Lead to Underpowered Studies with Erroneous Conclusions
title_sort current incentives for scientists lead to underpowered studies with erroneous conclusions
topic Perspective
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5104444/
https://www.ncbi.nlm.nih.gov/pubmed/27832072
http://dx.doi.org/10.1371/journal.pbio.2000995
work_keys_str_mv AT higginsonandrewd currentincentivesforscientistsleadtounderpoweredstudieswitherroneousconclusions
AT munafomarcusr currentincentivesforscientistsleadtounderpoweredstudieswitherroneousconclusions