Format

Send to

Choose Destination
Acad Med. 2009 Oct;84(10 Suppl):S83-5. doi: 10.1097/ACM.0b013e3181b37d01.

Measurement precision of spoken English proficiency scores on the USMLE step 2 clinical skills examination.

Author information

1
National Board of Medical Examiners, 3750 Market Street, Philadelphia, PA 19104, USA. mraymond@nbme.org

Abstract

BACKGROUND:

Previous research has shown that ratings of English proficiency on the United States Medical Licensing Examination Clinical Skills Examination are highly reliable. However, the score distributions for native and nonnative speakers of English are sufficiently different to suggest that reliability should be investigated separately for each group.

METHOD:

Generalizability theory was used to obtain reliability indices separately for native and nonnative speakers of English (N = 29,084). Conditional standard errors of measurement were also obtained for both groups to evaluate measurement precision for each group at specific score levels.

RESULTS:

Overall indices of reliability (phi) exceeded 0.90 for both native and nonnative speakers, and both groups were measured with nearly equal precision throughout the score distribution. However, measurement precision decreased at lower levels of proficiency for all examinees.

CONCLUSIONS:

The results of this and future studies may be helpful in understanding and minimizing sources of measurement error at particular regions of the score distribution.

PMID:
19907394
DOI:
10.1097/ACM.0b013e3181b37d01
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Wolters Kluwer
Loading ...
Support Center