Format

Send to

Choose Destination
Behav Res Methods. 2019 Oct;51(5):2194-2208. doi: 10.3758/s13428-019-01293-3.

Survey-software implicit association tests: A methodological and empirical analysis.

Author information

1
Seattle Pacific University, Seattle, WA, USA. tcarpenter@spu.edu.
2
University of Calgary, Calgary, Alberta, Canada.
3
Baylor University, Waco, TX, USA.
4
Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.
5
University of Cincinnati College of Medicine, Cincinnati, OH, USA.
6
University of Southern California, Los Angeles, CA, USA.
7
University of Maine, Orono, ME, USA.
8
Seattle Pacific University, Seattle, WA, USA.
9
Harvard University, Cambridge, MA, USA.

Abstract

The implicit association test (IAT) is widely used in psychology. Unfortunately, the IAT cannot be run within online surveys, requiring researchers who conduct online surveys to rely on third-party tools. We introduce a novel method for constructing IATs using online survey software (Qualtrics); we then empirically assess its validity. Study 1 (student n = 239) revealed good psychometric properties, expected IAT effects, and expected correlations with explicit measures for survey-software IATs. Study 2 (MTurk n = 818) showed predicted IAT effects across four survey-software IATs (ds = 0.82 [Black-White IAT] to 2.13 [insect-flower IAT]). Study 3 (MTurk n = 270) compared survey-software IATs and IATs run via Inquisit, yielding nearly identical results and intercorrelations that would be expected for identical IATs. Survey-software IATs appear to be reliable and valid, offer numerous advantages, and make IATs accessible for researchers who use survey software to conduct online research. We present all the materials, links to tutorials, and an open-source tool that rapidly automates survey-software IAT construction and analysis.

KEYWORDS:

Implicit association test; Implicit measures; Online research

PMID:
31515742
DOI:
10.3758/s13428-019-01293-3

Supplemental Content

Full text links

Icon for Springer
Loading ...
Support Center