Are predictions based on situational judgement tests precise enough for feedback in leadership development?

Guenole, Nigel; Chernyshenko, Oleksander; Stark, Stephen and Drasgow, Fritz. 2015. Are predictions based on situational judgement tests precise enough for feedback in leadership development? European Journal of Work and Organizational Psychology, 24(3), pp. 433-443. ISSN 1359-432X [Article]

[img] Text (Are Predictions based on Situational Judgment Tests Precise Enough for Feedback in Leadership Development?)
SJTPaperNigel.docx - Accepted Version
Available under License Creative Commons Attribution Non-commercial.

Download (82kB)
[img]
Preview
Text (Are Predictions based on Situational Judgment Tests Precise Enough for Feedback in Leadership Development?)
SJTPaperNigel.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.

Download (406kB) | Preview

Abstract or Description

Situational judgment tests (SJTs) have much to recommend their use for personnel selection, but because of their low reliability the role of SJTs in behavioural training is largely unexplored. However, research showing that SJTs cannot measure homogenous constructs very well is based exclusively on internal analyses, for example, alpha reliability and factor analysis. In this study, we investigated whether patterns of correlations with external criteria could be used to show that SJT dimension scores are homogenous enough for feedback purposes in leadership development. A multidimensional SJT was designed for 268 high potential leaders on a development programme and used in conjunction with a multisource feedback instrument that measured the same competency framework. The SJT was criterion keyed using against the multisource feedback instrument using an N-Fold cross validation strategy. Convergent and divergent correlations between the SJT scores and corresponding multisource dimension scores suggested that SJT scores can be constructed in a way that permits dimension level feedback that would be useful in leadership development.

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.1080/1359432X.2014.926890

Keywords:

Situational judgement, Construct validity, 360-Degree feedback, Psychometrics, Leadership development

Departments, Centres and Research Units:

Psychology

Dates:

DateEvent
19 May 2014Accepted
17 June 2014Published Online
2015Published

Item ID:

10341

Date Deposited:

19 May 2014 15:47

Last Modified:

09 Jun 2021 14:48

Peer Reviewed:

Yes, this version has been peer-reviewed.

URI:

https://research.gold.ac.uk/id/eprint/10341

View statistics for this item...

Edit Record Edit Record (login required)