Preprint Review Descriptors

The following terms are used to describe preprint review services listed on ReimagineReivew. Where applicable, these terms are also applied to journal review projects and trials.

    Name of Field

    Help text


    Review requested by

    Who submits or initiates the feedback process?



    Reviewer selected by

    Who selects the feedback providers?


    Editor, service, or community


    Review coverage

    Does the feedback cover the entire paper or only a certain section or aspect?

    Complete paper

    Specific aspects

    Reviewer identity known to

    Are the identities of reviewers known to everyone (public), editors or service, or noone?


    Editor or service


    Competing interests

    Is a declaration of competing interest required?



    Not included

    Public interaction

    Is there an opportunity for the public to engage as an integral part of the process?


    Not included

    Opportunity for author response

    Is the author’s response included as an integral part of the process?


    Not included


    Does the service provide a binary decision (accept/reject or recommendation) or a scalar rating after the review process?

    Binary decision

    Other scale or rating


    Below is a list of additional terms used to describe listings on ReimagineReview, some with descriptions and definitions.

    Types of project

    • Trials: Trials are time-limited experiments conducted by preexisting entities, such as journals and platforms.
    • Projects: Projects are platforms or services.
    • Observational studies: Observational studies are studies in which no intervention is made, but peer review is studied. Can include meta-analysis and modeling.


    • Proposed: Not yet under active development
    • In preparation: Under development, but not operating
    • Active: Currently operating
    • Complete: No longer active

    Types of outputs

    The type(s) of scientific product that is reviewed or evaluated by the project. For example, journals typically only evaluate manuscripts submitted directly (regardless of whether those manuscripts have been preprinted), so they should select “Privately shared manuscripts” unless preprints are specifically important to the evaluation process.
    • Journal accepted manuscripts: The evaluation occurs on papers that have already been published/accepted by a journal (post-publication evaluation).
    • Preprints
    • Other scholarly outputs: Data, protocol, code etc.
    • Privately shared manuscripts:  Note that a typically journal process operates on privately shared manuscripts. 


    • Double blind: Reviewers are unaware of the authors’ identities, and vice versa
    • Open interaction: Reviewers communicate with one another during the review process
    • Open reports: The content of peer review reports is published
    • Open identities: The identities of peer reviewers are published
    • Open participation: Anyone can participate in the peer review process
    • Single blind: Authors are unaware of reviewers’ identities, but NOT vice versa


    • Annotations
    • Free-form commenting
    • Structured review form


    • Automation: Filtering or evaluation of scientific output using automated technologies and programs. 
    • Comment moderation: Comments are screened or moderated before or after posting.
    • Journal integration: (For review happening outside the traditional journal format) editors at one or more journals integrate the content of the review into their own processes or the final presentation of the paper, or do journals send information to the project.
    • Pre-publication review: Review prior to public disclosure (of a preprint or other output).
    • Comment indexing: Comments are given a DOI or included in disciplinary databases
    • Comment rating (meta-evaluation): Comments can be up- or down-voted, highlighted, or reviewed themselves.
    • Post-publication review: Review after public disclosure (or a preprint or other output)
    • Professional editors
    • Preregistration: A proposed research plan that tests a predicted relationship, with a defined research timeline. De