Cargando…

Misunderstanding publication bias: editors are not blameless after all

In analysing whether there is an editorial bias in favour of positive studies, researchers have made implicit assumptions that are implausible. In particular, to justify the conclusion that there is no bias because observed editorial acceptance rates do not favour positive studies, the assumption th...

Descripción completa

Detalles Bibliográficos
Autor principal: Senn, Stephen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: F1000Research 2012
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3782365/
https://www.ncbi.nlm.nih.gov/pubmed/24358828
http://dx.doi.org/10.12688/f1000research.1-59.v1
_version_ 1782285536053952512
author Senn, Stephen
author_facet Senn, Stephen
author_sort Senn, Stephen
collection PubMed
description In analysing whether there is an editorial bias in favour of positive studies, researchers have made implicit assumptions that are implausible. In particular, to justify the conclusion that there is no bias because observed editorial acceptance rates do not favour positive studies, the assumption that the decision to submit an article is based solely on quality would be required. If, on the other hand, submission were based on perceived probability of acceptance, negative and positive studies would not differ in terms of acceptance rates, but in terms of quality. It is shown, using a simple graphical model, how similar underlying situations as regards the relationship between quality and probability of acceptance on the one hand and study outcome (positive or negative) and probability of acceptance on the other could produce dramatically different results depending on the behaviour of authors. Furthermore, there is, in fact, some evidence that submitted negative studies are, on average, of higher quality than positive ones. This calls into question the standard interpretation of the studies examining editorial bias. It would appear that despite similar probabilities of acceptance for negative and positive studies, editors could be discriminating against negative studies.
format Online
Article
Text
id pubmed-3782365
institution National Center for Biotechnology Information
language English
publishDate 2012
publisher F1000Research
record_format MEDLINE/PubMed
spelling pubmed-37823652013-12-05 Misunderstanding publication bias: editors are not blameless after all Senn, Stephen F1000Res Opinion Article In analysing whether there is an editorial bias in favour of positive studies, researchers have made implicit assumptions that are implausible. In particular, to justify the conclusion that there is no bias because observed editorial acceptance rates do not favour positive studies, the assumption that the decision to submit an article is based solely on quality would be required. If, on the other hand, submission were based on perceived probability of acceptance, negative and positive studies would not differ in terms of acceptance rates, but in terms of quality. It is shown, using a simple graphical model, how similar underlying situations as regards the relationship between quality and probability of acceptance on the one hand and study outcome (positive or negative) and probability of acceptance on the other could produce dramatically different results depending on the behaviour of authors. Furthermore, there is, in fact, some evidence that submitted negative studies are, on average, of higher quality than positive ones. This calls into question the standard interpretation of the studies examining editorial bias. It would appear that despite similar probabilities of acceptance for negative and positive studies, editors could be discriminating against negative studies. F1000Research 2012-12-04 /pmc/articles/PMC3782365/ /pubmed/24358828 http://dx.doi.org/10.12688/f1000research.1-59.v1 Text en Copyright: © 2012 Senn S http://creativecommons.org/licenses/by/3.0/ This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. http://creativecommons.org/publicdomain/zero/1.0/ Data associated with the article are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).
spellingShingle Opinion Article
Senn, Stephen
Misunderstanding publication bias: editors are not blameless after all
title Misunderstanding publication bias: editors are not blameless after all
title_full Misunderstanding publication bias: editors are not blameless after all
title_fullStr Misunderstanding publication bias: editors are not blameless after all
title_full_unstemmed Misunderstanding publication bias: editors are not blameless after all
title_short Misunderstanding publication bias: editors are not blameless after all
title_sort misunderstanding publication bias: editors are not blameless after all
topic Opinion Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3782365/
https://www.ncbi.nlm.nih.gov/pubmed/24358828
http://dx.doi.org/10.12688/f1000research.1-59.v1
work_keys_str_mv AT sennstephen misunderstandingpublicationbiaseditorsarenotblamelessafterall