ADVERTISEMENT
  About the SA Blog Network













Information Culture

Information Culture


Thoughts and analysis related to science information, data, publication and culture.
Information Culture HomeAboutContact

Can you take it with you when you go? Portable peer review

The views expressed are those of the author and are not necessarily those of Scientific American.


Email   PrintPrint



Being the first to do something matters. Just ask Pete Conrad and Alan Bean. Being the first to tell other folks that you did it matters too. Just ask Alfred Wallace.

For scientists, publication in a peer reviewed journal is the primary way of communicating experimental results, so getting a manuscript through the review process and into publication in a timely manner is important. This can get complicated if you are also trying to be published in the most prestigious journal possible.

For example, a scientist could submit their manuscript to a prestigious journal like Nature or Science. The article is sent out for review and within a few months (maybe faster) the authors get a note back saying that while their science was methodologically sound, it just wasn’t innovative enough for those journals. Next, the scientist submits it to the top journal in their field, only to be told in a few months that it was too interdisciplinary for that journal. A scientist may go through several rounds of submission and rejection looking for a suitable home for their manuscript, worrying as the months slip by that someone else has beat them to the publication of similar results.

This submission and rejection takes time and energy from authors, editors and reviewers when they could use that time researching or teaching. The process is widely considered to be inefficient.

Enter the folks behind new “portable peer review” services. Traditionally, the review process was done within the organizational structure of the journal you submitted your manuscript to. These new services are independent of specific journals and their goal is to cut down on the redundant work being done in the publication process. This separates the review process from the publication process, (one version of the decoupled journal described by Priem and Hemminger, 2012). Companies like Rubriq, Peerage of Science and Science Open Reviewed want authors to take their reviews with them as they search for an appropriate publication venue.

The decoupled journal, from Priem and Hemminger, 2012
In traditional publishing, all aspects of publication are carried out by the journal. Portable peer review services allow the assessment of article content to be performed outside of the traditional journal environment. Image from Priem and Hemminger, 2012.

 

While the details vary widely, it is similar to traditional journal based peer review. An author submits a manuscript, reviewers are located, and the reviewers provide commentary on the paper. The portable peer review services have generally taken the time to develop detailed rubrics and detailed guiding questions for reviewers. The authors can then revise their manuscripts and take everything to a journal of their choice. The portable peer review services are also working hard to cooperate with journal editors, allowing them to tell their authors that reviews from their service will be welcomed at specific journals. Some journals have instituted polices accepting outside peer review, like Elsevier’s Virology journal. Virology is starting to welcome manuscripts that have been rejected by higher impact journals if they include the original reviews, a revised manuscript and the author’s rebuttal in their submission package. BMC Biology, eLife, Biology Open, PLOS and EMBO are also cooperating and allowing authors to take their reviews with them.

Subscription journals have often mentioned that the management of the peer review process is one of the “value added” services that makes them worth the high costs. The portable peer review services have a variety of options for supporting themselves. Rubriq relies on author fees, right now around $600 per article (it is worth noting that Rubriq pays its reviewers). Peerage of Science is supported by several European universities and journal partners but does not charge author fees (nor does it pay reviewers). Science Open Reviewed helps connect authors and reviewers, allowing them to negotiate reviewing fees if they choose and is supported by Queen’s University in Ontario, CA.

Importantly, these services often mention the desire to develop a “reputation economy” for reviewers. While many reviewers take the time to provide polite, constructive criticism of a manuscript, there are others who may simply say “this sucks.” Knowing who is more likely to provide the former ahead of time could be useful. For example, Peerage of Science offers a “peer review of peer review” that rates reviewer reviews, and provides reviewer scores on reviewer profiles.

Although scientists recognize that peer review has problems, most recognize that it serves a valued role in communicating scientific research. New portable peer review services hope to improve the quality of reviews while simultaneously reducing the amount of redundancy in the publication system.

Works cited:

Priem, J., & Hemminger, B. M. (2012). Decoupling the scholarly journal. Frontiers in Computational Neuroscience, 6.  Available from: http://dx.doi.org/10.3389/fncom.2012.00019

Bonnie Swoger About the Author: Bonnie J. M. Swoger is a Science and Technology Librarian at a small public undergraduate institution in upstate New York, SUNY Geneseo. She teaches students about the science literature, helps faculty and students with library research questions and leads library assessment efforts. She has a BS in Geology from St. Lawrence University, an MS in Geology from Kent State University and an MLS from the University at Buffalo. She would love to have some free time in which to indulge in hobbies. She blogs at the Undergraduate Science Librarian. Follow on Twitter @bonnieswoger.

The views expressed are those of the author and are not necessarily those of Scientific American.





Rights & Permissions

Comments 3 Comments

Add Comment
  1. 1. Hadas Shema 5:36 pm 08/9/2013

    I love how everything we are familiar with in the publication process is being reinvented. And yes, most of the initiatives are going to fail, but those that survive will improve the way we publish peer-reviewed research.

    Great post as usual!

    Link to this
  2. 2. Pandelis 2:22 pm 08/10/2013

    Journal-independent peer review is gaining momentum and combined with self-archiving it can really challenge the current problematic academic publishing system.

    Apart from the services mentioned in the article, for a free, multidisciplinary platform facilitating an innovative “author-guided” open peer review check: http://www.libreapp.org
    run by an open membership, not-for-profit scholar organisation: http://www.openscholar.org.uk

    Link to this
  3. 3. David Cummings 9:52 pm 08/10/2013

    I’m not a scientist but I’ve long been interested in the peer review process as a spectator and interested amateur. It seems to me that this process of portable peer review is a very useful development for the advancement of science.

    Link to this

Add a Comment
You must sign in or register as a ScientificAmerican.com member to submit a comment.

More from Scientific American

Scientific American Holiday Sale

Give a Gift &
Get a Gift - Free!

Give a 1 year subscription as low as $14.99

Subscribe Now! >

X

Email this Article

X