Open peer review
Open peer review is the various possible modifications of the traditional scholarly peer review process. The three most common modifications to which the term is applied are:[1]
- Open identities: Authors and reviewers are aware of each other's identity.[2][3]
- Open reports: Review reports are published alongside the relevant article (rather than being kept confidential).
- Open participation: The wider community (and not just invited reviewers) are able to contribute to the review process.
These modifications are supposed to address various perceived shortcomings of the traditional scholarly peer review process, in particular its lack of transparency, lack of incentives, and wastefulness.[1]
Definitions
Open identities
Open peer review may be defined as "any scholarly review mechanism providing disclosure of author and referee identities to one another at any point during the peer review or publication process".[4] Then reviewer's identities may or may not be disclosed to the public. This is in contrast to the traditional peer review process where reviewers remain anonymous to anyone but the journal's editors, while authors' names are disclosed from the beginning.
Open reports
Open peer review may be defined as making the reviewers' reports public, instead of disclosing them to the article's authors only. This may include publishing the rest of the peer review history, i.e. the authors' replies and editors' recommendations. Most often, this concerns only articles that are accepted for publication, and not those that are rejected.
Open participation
Open peer review may be defined as allowing self-selected reviewers to comment on an article, rather than (or in addition to) having reviewers who are selected by the editors. This assumes that the text of the article is openly accessible. The self-selected reviewers may or may not be screened for their basic credentials, and they may contribute either short comments or full reviews.[1]
Adoption
Adoption by publishers
These publishers operate various flavours of open peer review:
- BMJ Group
- BioMed Central
- Copernicus Publications
- European Molecular Biology Organization (EMBO)
- PeerJ
- eLife
- PLOS
- WikiJournal
- SciPost
- Nature[5]
- Semantic Web journal by IOS Press
Peer review at BMJ,[6] BioMed Central,[7] EMBO,[8] eLife,[9], PLOS[10] and the Semantic Web journal[11] involves posting the entire pre-publication history of the article online, including not only signed reviews of the article, but also its previous versions and in some cases names of handling editors and author responses to the reviewers. The European Geosciences Union operates public discussions where open peer review is conducted before suitable articles are accepted for publication in the actual journal.[12]
Open peer review of preprints
Some platforms, including some preprint servers, facilitate open peer review of preprints.
- In 2019, the preprint server BioRxiv started allowing posting reviews alongside preprints, in addition to allowing comments on preprints. The reviews can come from journals or from platforms such as Review Commons.[13]
- In 2020, in the context of the COVID-19 pandemic, the platform Outbreak Science Rapid PREreview was launched in order to perform rapid open peer review of preprints related to emerging outbreaks. The platform initially worked with preprints from medRxiv, bioRxiv and arXiv.[14]
Advantages and disadvantages
Argued
Open identities have been argued to incite reviewers to be "more tactful and constructive" than they would be if they could remain anonymous, while however allowing authors to accumulate enemies who try to keep their papers from being published or their grant applications from being successful.[15]
Open peer review in all its forms has been argued to favour more honest reviewing, and to prevent reviewers from following their individual agendas.[16]
Observed
In an experiment with 56 research articles accepted by the Medical Journal of Australia in 1996-1997, the articles were published online together with the peer reviewers' comments; readers could email their comments and the authors could amend their articles further before print publication.[17] The investigators concluded that the process had modest benefits for authors, editors and readers.
Some studies have found that open identities lead to an increase in the quality of reviews, while other studies find no significant effect.[18]
Open peer review at BMJ journals has lent itself to randomized trials that compared open peer review (with open identities and open reports) with non-open peer review. These studies did not find that open peer review significantly affected the quality of review or the rate of acceptance of articles for publication, and there was only one reported instance of a conflict between authors and reviewers ("adverse event"). The only significant negative effect of open peer review was "increasing the likelihood of reviewers declining to review".[3][19]
In some cases, open identities have helped detect reviewers' conflicts of interests.[20]
According to a 2020 Nature editorial,[5] experience from Nature Communications negates the concerns that open reports would be less critical, or would require an excessive amount of work from reviewers.
See also
References
- ^ a b c Ross-Hellauer, Tony (2017-08-31). "What is open peer review? A systematic review". F1000Research. 6. F1000 Research Ltd: 588. doi:10.12688/f1000research.11369.2. ISSN 2046-1402. PMC 5437951. PMID 28580134.
{{cite journal}}
: CS1 maint: unflagged free DOI (link) - ^ Walsh E, Rooney M, Appleby L, Wilkinson G (January 2000). "Open peer review: a randomised controlled trial". The British Journal of Psychiatry. 176 (1): 47–51. doi:10.1192/bjp.176.1.47. PMID 10789326.
- ^ a b van Rooyen S, Godlee F, Evans S, Black N, Smith R (January 1999). "Effect of open peer review on quality of reviews and on reviewers' recommendations: a randomised trial". BMJ. 318 (7175): 23–7. doi:10.1136/bmj.318.7175.23. PMC 27670. PMID 9872878.
- ^ Ford E (2015-07-20). "Open peer review at four STEM journals: an observational overview". F1000Research. 4: 6. doi:10.12688/f1000research.6005.2. PMC 4350441. PMID 25767695.
{{cite journal}}
: CS1 maint: unflagged free DOI (link) - ^ a b "Nature will publish peer review reports as a trial". Nature. 578 (7793): 8. 2020. Bibcode:2020Natur.578....8.. doi:10.1038/d41586-020-00309-9. PMID 32025024.
- ^ Groves T, Loder E (September 2014). "Prepublication histories and open peer review at the BMJ". BMJ. 349 (sep03 13): g5394. doi:10.1136/bmj.g5394. PMID 25186622.
{{cite journal}}
: Unknown parameter|name-list-format=
ignored (|name-list-style=
suggested) (help) - ^ "What is 'open peer review', as operated by the medical journals in the BMC series?". BioMed Central. Retrieved 31 July 2015.
- ^ Pulverer B (November 2010). "Transparency showcases strength of peer review". Nature. 468 (7320): 29–31. Bibcode:2010Natur.468...29P. doi:10.1038/468029a. PMID 21048742.
{{cite journal}}
: Unknown parameter|name-list-format=
ignored (|name-list-style=
suggested) (help) - ^ "Peer review". eLife. Retrieved 30 December 2019.
- ^ "PLOS Journals Now OPEN for Published Peer Review". PLOS. 22 May 2019. Retrieved 30 December 2019.
- ^ Janowicz, Krzysztof; Hitzler, Pascal (January 2012). "Open and transparent: the review process of the Semantic Web journal". Learned Publishing. 25 (1): 48–55. doi:10.1087/20120107.
- ^ "Online + Open Access Publishing". European Geosciences Union. Retrieved 30 December 2019.
- ^ Brainard, Jeffrey (2019-10-10). "In bid to boost transparency, bioRxiv begins posting peer reviews next to preprints". Science. American Association for the Advancement of Science (AAAS). doi:10.1126/science.aaz8160. ISSN 0036-8075.
- ^ Johansson, Michael A.; Saderi, Daniela (2020). "Open peer-review platform for COVID-19 preprints". Nature. 579 (7797). Springer Science and Business Media LLC: 29. Bibcode:2020Natur.579...29J. doi:10.1038/d41586-020-00613-4. ISSN 0028-0836. PMID 32127711.
- ^ Decoursey, Thomas (March 1999). "Pros and cons of open peer review". Nature Neuroscience. 2 (3): 197–8. doi:10.1038/nature04991. PMID 10195206.
- ^ "What is peer review?". Elsevier. Retrieved 31 July 2015.
- ^ Bingham, Craig M.; Higgins, Gail; Coleman, Ross; Van Der Weyden, Martin B. (1998). "The Medical Journal of Australia internet peer-review study". The Lancet. 352 (9126): 441–445. doi:10.1016/S0140-6736(97)11510-0. PMID 9708752.
- ^ Lee, Carole J.; Sugimoto, Cassidy R.; Zhang, Guo; Cronin, Blaise (January 2013). "Bias in peer review". Journal of the American Society for Information Science and Technology. 64 (1): 2–17. doi:10.1002/asi.22784.
{{cite journal}}
: Unknown parameter|name-list-format=
ignored (|name-list-style=
suggested) (help) - ^ van Rooyen S, Delamothe T, Evans SJ (November 2010). "Effect on peer review of telling reviewers that their signed reviews might be posted on the web: randomised controlled trial". BMJ. 341: c5729. doi:10.1136/bmj.c5729. PMC 2982798. PMID 21081600.
- ^ Benos DJ, Bashari E, Chaves JM, Gaggar A, Kapoor N, LaFrance M, Mans R, Mayhew D, McGowan S, Polter A, Qadri Y, Sarfare S, Schultz K, Splittgerber R, Stephenson J, Tower C, Walton RG, Zotov A (June 2007). "The ups and downs of peer review". Advances in Physiology Education. 31 (2): 145–52. doi:10.1152/advan.00104.2006. PMID 17562902.