Display Settings:

Format

Send to:

Choose Destination
See comment in PubMed Commons below
Med Educ. 2002 Oct;36(10):972-8.

Generalisability: a key to unlock professional assessment.

Author information

  • 1Department of Paediatric Medicine, Sheffield Children's Hospital, Sheffield, UK.

Erratum in

  • Med Educ. 2003 Jun;37(6):574.

Abstract

CONTEXT:

Reliability is defined as the extent to which a result reflects all possible measurements of the same construct. It is an essential measurement characteristic. Unfortunately, there are few objective tests for the most important aspects of the professional role because they are complex and intangible. In addition, professional performance varies markedly from setting to setting and case to case. Both these factors threaten reliability.

AIM:

This paper describes the classical approach to evaluating reliability and points out the limitations of this approach. It goes on to describe how generalisability theory solves many of these limitations.

CONDITIONS:

A G-study uses variance component analysis to measure the contributions that all relevant factors make to the result (observer, situation, case, assessee and their interactions). This information can be combined to reflect the reliability of a single observation as a reflection of all possible measurements - a true reflection of reliability. It can also be used to estimate the reliability of a combined sample of several different observations, or to predict how many observations are required with different test formats to achieve a given level of reliability. Worked examples are used to illustrate the concepts.

PMID:
12390466
[PubMed - indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Blackwell Publishing
    Loading ...
    Write to the Help Desk