Cargando…

The impact of peer review on the contribution potential of scientific papers

The peer-reviewing process has long been regarded as an indispensable tool in ensuring the quality of a scientific publication. While previous studies have tried to understand the process as a whole, not much effort has been devoted to investigating the determinants and impacts of the content of the...

Descripción completa

Detalles Bibliográficos
Autores principales: Matsui, Akira, Chen, Emily, Wang, Yunwen, Ferrara, Emilio
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8459734/
https://www.ncbi.nlm.nih.gov/pubmed/34616596
http://dx.doi.org/10.7717/peerj.11999
_version_ 1784571591226556416
author Matsui, Akira
Chen, Emily
Wang, Yunwen
Ferrara, Emilio
author_facet Matsui, Akira
Chen, Emily
Wang, Yunwen
Ferrara, Emilio
author_sort Matsui, Akira
collection PubMed
description The peer-reviewing process has long been regarded as an indispensable tool in ensuring the quality of a scientific publication. While previous studies have tried to understand the process as a whole, not much effort has been devoted to investigating the determinants and impacts of the content of the peer review itself. This study leverages open data from nearly 5,000 PeerJ publications that were eventually accepted. Using sentiment analysis, Latent Dirichlet Allocation (LDA) topic modeling, mixed linear regression models, and logit regression models, we examine how the peer-reviewing process influences the acceptance timeline and contribution potential of manuscripts, and what modifications were typically made to manuscripts prior to publication. In an open review paradigm, our findings indicate that peer reviewers’ choice to reveal their names in lieu of remaining anonymous may be associated with more positive sentiment in their review, implying possible social pressure from name association. We also conduct a taxonomy of the manuscript modifications during a revision, studying the words added in response to peer reviewer feedback. This study provides insights into the content of peer reviews and the subsequent modifications authors make to their manuscripts.
format Online
Article
Text
id pubmed-8459734
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-84597342021-10-05 The impact of peer review on the contribution potential of scientific papers Matsui, Akira Chen, Emily Wang, Yunwen Ferrara, Emilio PeerJ Science Policy The peer-reviewing process has long been regarded as an indispensable tool in ensuring the quality of a scientific publication. While previous studies have tried to understand the process as a whole, not much effort has been devoted to investigating the determinants and impacts of the content of the peer review itself. This study leverages open data from nearly 5,000 PeerJ publications that were eventually accepted. Using sentiment analysis, Latent Dirichlet Allocation (LDA) topic modeling, mixed linear regression models, and logit regression models, we examine how the peer-reviewing process influences the acceptance timeline and contribution potential of manuscripts, and what modifications were typically made to manuscripts prior to publication. In an open review paradigm, our findings indicate that peer reviewers’ choice to reveal their names in lieu of remaining anonymous may be associated with more positive sentiment in their review, implying possible social pressure from name association. We also conduct a taxonomy of the manuscript modifications during a revision, studying the words added in response to peer reviewer feedback. This study provides insights into the content of peer reviews and the subsequent modifications authors make to their manuscripts. PeerJ Inc. 2021-09-15 /pmc/articles/PMC8459734/ /pubmed/34616596 http://dx.doi.org/10.7717/peerj.11999 Text en © 2021 Matsui et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ) and either DOI or URL of the article must be cited.
spellingShingle Science Policy
Matsui, Akira
Chen, Emily
Wang, Yunwen
Ferrara, Emilio
The impact of peer review on the contribution potential of scientific papers
title The impact of peer review on the contribution potential of scientific papers
title_full The impact of peer review on the contribution potential of scientific papers
title_fullStr The impact of peer review on the contribution potential of scientific papers
title_full_unstemmed The impact of peer review on the contribution potential of scientific papers
title_short The impact of peer review on the contribution potential of scientific papers
title_sort impact of peer review on the contribution potential of scientific papers
topic Science Policy
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8459734/
https://www.ncbi.nlm.nih.gov/pubmed/34616596
http://dx.doi.org/10.7717/peerj.11999
work_keys_str_mv AT matsuiakira theimpactofpeerreviewonthecontributionpotentialofscientificpapers
AT chenemily theimpactofpeerreviewonthecontributionpotentialofscientificpapers
AT wangyunwen theimpactofpeerreviewonthecontributionpotentialofscientificpapers
AT ferraraemilio theimpactofpeerreviewonthecontributionpotentialofscientificpapers
AT matsuiakira impactofpeerreviewonthecontributionpotentialofscientificpapers
AT chenemily impactofpeerreviewonthecontributionpotentialofscientificpapers
AT wangyunwen impactofpeerreviewonthecontributionpotentialofscientificpapers
AT ferraraemilio impactofpeerreviewonthecontributionpotentialofscientificpapers