biOverlay

Reviewers are selected by editors based on relevant expertise, similar to journal peer review. Editors self-nominate by submitting a CV and are reviewed by a the board of managing editors.

No

Associate Editors are asked to consider what the most impactful item for review is at the time that they select a preprint or publication to send out for review. An editor has viewed it as the scholarly output most worthy of review at that time.

0

10-100

We expected that preprints reviewed on biOverlay would be among the highest profile contributions within our various disciplines. Many preprints covered by biOverlay were published in numerous journals that seek to publish work of broad interest, suggesting that our associate editors were choosing papers that others found interesting as well.

We’re closing biOverlay now for a few reasons. First, it may have made it more difficult for authors to publish strong papers. We are aware of one case where reviews from biOverlay were used, but the authors, in a subsequent blog post, noted that they were then expected to respond to five reviewers. We would prefer that editors and authors take all comments under consideration and take a nuanced perspective to request that authors focus their efforts on the most salient ones. While some comments were overlapping, this didn’t make an apparently strong paper of great general interest more straightforward to publish. Second, without information as to the current submission/review status of a preprint, it was unclear if biOverlay reviews would be helpful. Third, without a clear impact on subsequent publication, potential reviewers lacked one incentive to accept our invitations. All of these factors were cited by potential reviewers when declining invitations.

We found that posting a preprint is insufficient to signal to potential reviewers that authors welcome feedback. New efforts, such as Review Commons from EMBO and ASAPbio, eLife’s preprint review trial, and PREreview’s live-streamed journal clubs provide author-initiated platforms to produce a similar outcome. Additionally, bioRxiv and other preprint servers could provide a way for authors to signal that they welcome feedback or report a manuscript’s submission/review status.

https://www.bioverlay.org/post/2020-01-experiment-summary/