Format

Send to

Choose Destination
Behav Res Methods. 2019 Aug;51(4):1782-1803. doi: 10.3758/s13428-018-1155-z.

A thousand studies for the price of one: Accelerating psychological science with Pushkin.

Author information

1
Department of Psychology, Boston College, Newton, MA, USA. hartshoj@bc.edu.
2
Department of Cognitive Science, Vassar College, Poughkeepsie, NY, USA.
3
Department of Psychology, Stanford University, Stanford, CA, USA.
4
Department of Psychology, Boston College, Newton, MA, USA.
5
Department of Linguistics, McGill University, Montreal, Quebec, Canada.

Abstract

Half of the world's population has internet access. In principle, researchers are no longer limited to subjects they can recruit into the laboratory. Any study that can be run on a computer or mobile device can be run with nearly any demographic anywhere in the world, and in large numbers. This has allowed scientists to effectively run hundreds of experiments at once. Despite their transformative power, such studies remain rare for practical reasons: the need for sophisticated software, the difficulty of recruiting so many subjects, and a lack of research paradigms that make effective use of their large amounts of data, due to such realities as that they require sophisticated software in order to run effectively. We present Pushkin: an open-source platform for designing and conducting massive experiments over the internet. Pushkin allows for a wide range of behavioral paradigms, through integration with the intuitive and flexible jsPsych experiment engine. It also addresses the basic technical challenges associated with massive, worldwide studies, including auto-scaling, extensibility, machine-assisted experimental design, multisession studies, and data security.

KEYWORDS:

Citizen science; Massive online experiments; Online studies; Robust and reliable research

PMID:
30746644
DOI:
10.3758/s13428-018-1155-z

Supplemental Content

Full text links

Icon for Springer
Loading ...
Support Center