Format

Send to

Choose Destination
Adv Health Sci Educ Theory Pract. 2008 Mar;13(1):59-69. Epub 2006 Jul 27.

Checklist content on a standardized patient assessment: an ex post facto review.

Author information

1
Educational Commission for Foreign Medical Graduates (ECFMG), Philadelphia, PA 19104-2685, USA. jboulet@ecfmg.org

Abstract

While checklists are often used to score standardized patient based clinical assessments, little research has focused on issues related to their development or the level of agreement with respect to the importance of specific items. Five physicians independently reviewed checklists from 11 simulation scenarios that were part of the former Educational Commission for Foreign Medical Graduate's Clinical Skills Assessment and classified the clinical appropriateness of each of the checklist items. Approximately 78% of the original checklist items were judged to be needed, or indicated, given the presenting complaint and the purpose of the assessment. Rater agreement was relatively poor with pairwise associations (Kappa coefficient) ranging from 0.09 to 0.29. However, when only consensus indicated items were included, there was little change in examinee scores, including their reliability over encounters. Although most checklist items in this sample were judged to be appropriate, some could potentially be eliminated, thereby minimizing the scoring burden placed on the standardized patients. Periodic review of checklist items, concentrating on their clinical importance, is warranted.

PMID:
16871427
DOI:
10.1007/s10459-006-9024-4
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Springer
Loading ...
Support Center