Format

Send to

Choose Destination
See comment in PubMed Commons below
Front Comput Neurosci. 2012 Oct 1;6:72. doi: 10.3389/fncom.2012.00072. eCollection 2012.

Designing next-generation platforms for evaluating scientific output: what scientists can learn from the social web.

Author information

  • 1Institute of Cognitive Science, University of Colorado Boulder Boulder, CO, USA.

Abstract

Traditional pre-publication peer review of scientific output is a slow, inefficient, and unreliable process. Efforts to replace or supplement traditional evaluation models with open evaluation platforms that leverage advances in information technology are slowly gaining traction, but remain in the early stages of design and implementation. Here I discuss a number of considerations relevant to the development of such platforms. I focus particular attention on three core elements that next-generation evaluation platforms should strive to emphasize, including (1) open and transparent access to accumulated evaluation data, (2) personalized and highly customizable performance metrics, and (3) appropriate short-term incentivization of the userbase. Because all of these elements have already been successfully implemented on a large scale in hundreds of existing social web applications, I argue that development of new scientific evaluation platforms should proceed largely by adapting existing techniques rather than engineering entirely new evaluation mechanisms. Successful implementation of open evaluation platforms has the potential to substantially advance both the pace and the quality of scientific publication and evaluation, and the scientific community has a vested interest in shifting toward such models as soon as possible.

KEYWORDS:

data sharing; open access; peer review; publishing; scientific evaluation

PMID:
23060783
PMCID:
PMC3461500
DOI:
10.3389/fncom.2012.00072
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Frontiers Media SA Icon for PubMed Central
    Loading ...
    Support Center