Cargando…

Re-evaluation of solutions to the problem of unprofessionalism in peer review

Our recent paper (10.1186/s41073-020-00096-x) reported that 43% of reviewer comment sets (n=1491) shared with authors contained at least one unprofessional comment or an incomplete, inaccurate of unsubstantiated critique (IIUC). Publication of this work sparked an online (i.e., Twitter, Instagram, F...

Descripción completa

Detalles Bibliográficos
Autores principales: Gerwing, Travis G., Allen Gerwing, Alyssa M., Choi, Chi-Yeung, Avery-Gomm, Stephanie, Clements, Jeff C., Rash, Joshua A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7885247/
https://www.ncbi.nlm.nih.gov/pubmed/33588947
http://dx.doi.org/10.1186/s41073-020-00107-x
_version_ 1783651567573925888
author Gerwing, Travis G.
Allen Gerwing, Alyssa M.
Choi, Chi-Yeung
Avery-Gomm, Stephanie
Clements, Jeff C.
Rash, Joshua A.
author_facet Gerwing, Travis G.
Allen Gerwing, Alyssa M.
Choi, Chi-Yeung
Avery-Gomm, Stephanie
Clements, Jeff C.
Rash, Joshua A.
author_sort Gerwing, Travis G.
collection PubMed
description Our recent paper (10.1186/s41073-020-00096-x) reported that 43% of reviewer comment sets (n=1491) shared with authors contained at least one unprofessional comment or an incomplete, inaccurate of unsubstantiated critique (IIUC). Publication of this work sparked an online (i.e., Twitter, Instagram, Facebook, and Reddit) conversation surrounding professionalism in peer review. We collected and analyzed these social media comments as they offered real-time responses to our work and provided insight into the views held by commenters and potential peer-reviewers that would be difficult to quantify using existing empirical tools (96 comments from July 24th to September 3rd, 2020). Overall, 75% of comments were positive, of which 59% were supportive and 16% shared similar personal experiences. However, a subset of negative comments emerged (22% of comments were negative and 6% were an unsubstantiated critique of the methodology), that provided potential insight into the reasons underlying unprofessional comments were made during the peer-review process. These comments were classified into three main themes: (1) forced niceness will adversely impact the peer-review process and allow for publication of poor-quality science (5% of online comments); (2) dismissing comments as not offensive to another person because they were not deemed personally offensive to the reader (6%); and (3) authors brought unprofessional comments upon themselves as they submitted substandard work (5%). Here, we argue against these themes as justifications for directing unprofessional comments towards authors during the peer review process. We argue that it is possible to be both critical and professional, and that no author deserves to be the recipient of demeaning ad hominem attacks regardless of supposed provocation. Suggesting otherwise only serves to propagate a toxic culture within peer review. While we previously postulated that establishing a peer-reviewer code of conduct could help improve the peer-review system, we now posit that priority should be given to repairing the negative cultural zeitgeist that exists in peer-review.
format Online
Article
Text
id pubmed-7885247
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-78852472021-02-17 Re-evaluation of solutions to the problem of unprofessionalism in peer review Gerwing, Travis G. Allen Gerwing, Alyssa M. Choi, Chi-Yeung Avery-Gomm, Stephanie Clements, Jeff C. Rash, Joshua A. Res Integr Peer Rev Commentary Our recent paper (10.1186/s41073-020-00096-x) reported that 43% of reviewer comment sets (n=1491) shared with authors contained at least one unprofessional comment or an incomplete, inaccurate of unsubstantiated critique (IIUC). Publication of this work sparked an online (i.e., Twitter, Instagram, Facebook, and Reddit) conversation surrounding professionalism in peer review. We collected and analyzed these social media comments as they offered real-time responses to our work and provided insight into the views held by commenters and potential peer-reviewers that would be difficult to quantify using existing empirical tools (96 comments from July 24th to September 3rd, 2020). Overall, 75% of comments were positive, of which 59% were supportive and 16% shared similar personal experiences. However, a subset of negative comments emerged (22% of comments were negative and 6% were an unsubstantiated critique of the methodology), that provided potential insight into the reasons underlying unprofessional comments were made during the peer-review process. These comments were classified into three main themes: (1) forced niceness will adversely impact the peer-review process and allow for publication of poor-quality science (5% of online comments); (2) dismissing comments as not offensive to another person because they were not deemed personally offensive to the reader (6%); and (3) authors brought unprofessional comments upon themselves as they submitted substandard work (5%). Here, we argue against these themes as justifications for directing unprofessional comments towards authors during the peer review process. We argue that it is possible to be both critical and professional, and that no author deserves to be the recipient of demeaning ad hominem attacks regardless of supposed provocation. Suggesting otherwise only serves to propagate a toxic culture within peer review. While we previously postulated that establishing a peer-reviewer code of conduct could help improve the peer-review system, we now posit that priority should be given to repairing the negative cultural zeitgeist that exists in peer-review. BioMed Central 2021-02-16 /pmc/articles/PMC7885247/ /pubmed/33588947 http://dx.doi.org/10.1186/s41073-020-00107-x Text en © The Author(s) 2021 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Commentary
Gerwing, Travis G.
Allen Gerwing, Alyssa M.
Choi, Chi-Yeung
Avery-Gomm, Stephanie
Clements, Jeff C.
Rash, Joshua A.
Re-evaluation of solutions to the problem of unprofessionalism in peer review
title Re-evaluation of solutions to the problem of unprofessionalism in peer review
title_full Re-evaluation of solutions to the problem of unprofessionalism in peer review
title_fullStr Re-evaluation of solutions to the problem of unprofessionalism in peer review
title_full_unstemmed Re-evaluation of solutions to the problem of unprofessionalism in peer review
title_short Re-evaluation of solutions to the problem of unprofessionalism in peer review
title_sort re-evaluation of solutions to the problem of unprofessionalism in peer review
topic Commentary
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7885247/
https://www.ncbi.nlm.nih.gov/pubmed/33588947
http://dx.doi.org/10.1186/s41073-020-00107-x
work_keys_str_mv AT gerwingtravisg reevaluationofsolutionstotheproblemofunprofessionalisminpeerreview
AT allengerwingalyssam reevaluationofsolutionstotheproblemofunprofessionalisminpeerreview
AT choichiyeung reevaluationofsolutionstotheproblemofunprofessionalisminpeerreview
AT averygommstephanie reevaluationofsolutionstotheproblemofunprofessionalisminpeerreview
AT clementsjeffc reevaluationofsolutionstotheproblemofunprofessionalisminpeerreview
AT rashjoshuaa reevaluationofsolutionstotheproblemofunprofessionalisminpeerreview