The Internal Structure of Situational Judgment Tests Reflects Candidate Main Effects: Not Dimensions or Situations

Jackson, Duncan; Alexander, Lopilato; Dan, Hughes; Nigel, Guenole and Ali, Shalfrooshan. 2017. The Internal Structure of Situational Judgment Tests Reflects Candidate Main Effects: Not Dimensions or Situations. Journal of Occupational and Organizational Psychology, 90(1), pp. 1-27. ISSN 0963-1798 [Article]

[img]
Preview
Text
Jackson et al. (accepted at JOOP 25.05.16).pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (792kB) | Preview

Abstract or Description

Despite their popularity and capacity to predict performance, there is no clear consensus on the internal measurement characteristics of situational judgment tests (SJTs). Contemporary propositions in the literature focus on treating SJTs as methods, as measures of dimensions, or as measures of situational responses. However, empirical evidence relating to the internal structure of SJT scores is lacking. Using generalizability theory, we decomposed multiple sources of variance for three different SJTs used with different samples of job candidates (N1 = 2,320; N2 =989; N3 = 7,934). Results consistently indicated that (a) the vast majority of reliable observed score variance reflected SJT-specific candidate main effects, analogous to a general judgment factor and that (b) the contribution of dimensions and situations to reliable SJT variance was, in relative terms, negligible. These findings do not align neatly with any of the proposals in the contemporary literature; however they do suggest an internal structure for SJTs.

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.1111/joop.12151

Departments, Centres and Research Units:

Psychology

Dates:

DateEvent
25 June 2016Published Online
1 March 2017Published
15 April 2016Accepted

Item ID:

18461

Date Deposited:

27 May 2016 08:18

Last Modified:

29 Apr 2020 16:18

Peer Reviewed:

Yes, this version has been peer-reviewed.

URI:

https://research.gold.ac.uk/id/eprint/18461

View statistics for this item...

Edit Record Edit Record (login required)