Format

Send to

Choose Destination
See comment in PubMed Commons below
Adv Health Sci Educ Theory Pract. 2017 May;22(2):401-413. doi: 10.1007/s10459-017-9755-4. Epub 2017 Feb 8.

Evaluating the complementary roles of an SJT and academic assessment for entry into clinical practice.

Author information

1
Work Psychology Group, 27 Brunel Parkway, Pride Park, Derby, DE24 8HR, UK. fcc9@le.ac.uk.
2
Occupational Psychology, Department of Neuroscience, Psychology and Behaviour, University of Leicester, Leicester, LE1 7RH, UK. fcc9@le.ac.uk.
3
Work Psychology Group, 27 Brunel Parkway, Pride Park, Derby, DE24 8HR, UK.
4
Department of Psychology, University of Cambridge, Downing Street, Cambridge, CB2 3EB, UK.
5
Scotland Foundation School Director, NHS Education for Scotland, Forest Grove House, Foresterhill Road, Aberdeen, AB25 2ZP, Scotland, UK.
6
UK Foundation Programme Office, St Chad's Court, 213 Hagley Road, Edgbaston, Birmingham, B16 9RG, UK.
7
Durham University, Holliday Building, Thornaby, TS17 6BH, UK.
8
Department of Psychology, University of Cambridge, Kings College, Downing Street, Cambridge, CB2 3EB, UK.

Abstract

Although there is extensive evidence confirming the predictive validity of situational judgement tests (SJTs) in medical education, there remains a shortage of evidence for their predictive validity for performance of postgraduate trainees in their first role in clinical practice. Moreover, to date few researchers have empirically examined the complementary roles of academic and non-academic selection methods in predicting in-role performance. This is an important area of enquiry as despite it being common practice to use both types of methods within a selection system, there is currently no evidence that this approach translates into increased predictive validity of the selection system as a whole, over that achieved by the use of a single selection method. In this preliminary study, the majority of the range of scores achieved by successful applicants to the UK Foundation Programme provided a unique opportunity to address both of these areas of enquiry. Sampling targeted high (>80th percentile) and low (<20th percentile) scorers on the SJT. Supervisors rated 391 trainees' in-role performance, and incidence of remedial action was collected. SJT and academic performance scores correlated with supervisor ratings (r = .31 and .28, respectively). The relationship was stronger between the SJT and in-role performance for the low scoring group (r = .33, high scoring group r = .11), and between academic performance and in-role performance for the high scoring group (r = .29, low scoring group r = .11). Trainees with low SJT scores were almost five times more likely to receive remedial action. Results indicate that an SJT for entry into trainee physicians' first role in clinical practice has good predictive validity of supervisor-rated performance and incidence of remedial action. In addition, an SJT and a measure of academic performance appeared to be complementary to each other. These initial findings suggest that SJTs may be more predictive at the lower end of a scoring distribution, and academic attainment more predictive at the higher end.

KEYWORDS:

Academic attainment; In-role performance; Predictive validity; Situational judgement tests; Supervisor ratings; Trainee physicians

PMID:
28181019
DOI:
10.1007/s10459-017-9755-4
[Indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Springer
    Loading ...
    Support Center