Format

Send to

Choose Destination
See comment in PubMed Commons below
J Appl Psychol. 2007 Jul;92(4):1043-55.

Situational judgment tests in high-stakes settings: issues and strategies with generating alternate forms.

Author information

1
Department of Personnel Management and Work and Organizational Psychology, Ghent University, Ghent, Belgium. Filip.Lievens@ugent.be

Abstract

This study used principles underlying item generation theory to posit competing perspectives about which features of situational judgment tests might enhance or impede consistent measurement across repeat test administrations. This led to 3 alternate-form development approaches (random assignment, incident isomorphism, and item isomorphism). The effects of these approaches on alternate-form consistency, mean score changes, and criterion-related validity were examined in a high-stakes context (N = 3,361). Generally, results revealed that even small changes in the context of the situations presented resulted in significantly lower alternate-form consistency. Conversely, placing more constraints on the alternate-form development process proved beneficial. The contributions, implications, and limitations of these results for the development of situational judgment tests and high-stakes testing are discussed.

PMID:
17638464
DOI:
10.1037/0021-9010.92.4.1043
[Indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for American Psychological Association
    Loading ...
    Support Center