Systematizing Audit in Algorithmic Recruitment

Kazim, Emre; Koshiyama, Adriano Soares; Hilliard, Airlie and Polle, Roseline. 2021. Systematizing Audit in Algorithmic Recruitment. Journal of Intelligence, 9(3), 46. ISSN 2079-3200 [Article]

jintelligence-09-00046.pdf - Published Version
Available under License Creative Commons Attribution.

Download (324kB) | Preview

Abstract or Description

Business psychologists study and assess relevant individual differences, such as intelligence and personality, in the context of work. Such studies have informed the development of artificial intelligence systems (AI) designed to measure individual differences. This has been capitalized on by companies who have developed AI-driven recruitment solutions that include aggregation of appropriate candidates (Hiretual), interviewing through a chatbot (Paradox), video interview assessment (MyInterview), and CV-analysis (Textio), as well as estimation of psychometric characteristics through image-(Traitify) and game-based assessments (HireVue) and video interviews (Cammio). However, driven by concern that such high-impact technology must be used responsibly due to the potential for unfair hiring to result from the algorithms used by these tools, there is an active effort towards proving mechanisms of governance for such automation. In this article, we apply a systematic algorithm audit framework in the context of the ethically critical industry of algorithmic recruitment systems, exploring how audit assessments on AI-driven systems can be used to assure that such systems are being responsibly deployed in a fair and well-governed manner. We outline sources of risk for the use of algorithmic hiring tools, suggest the most appropriate opportunities for audits to take place, recommend ways to measure bias in algorithms, and discuss the transparency of algorithms.

Item Type:


Identification Number (DOI):

Additional Information:

The authors would like to acknowledge Cisco Research Centre for their research grant (2020-222054 3696).


transparency; accountability; governance; compliance; robustness; explainability; privacy; bias; fairness; recruitment

Departments, Centres and Research Units:

Institute of Management Studies


14 September 2021Accepted
17 September 2021Published

Item ID:


Date Deposited:

06 Oct 2021 14:28

Last Modified:

06 Oct 2021 14:28

Peer Reviewed:

Yes, this version has been peer-reviewed.


View statistics for this item...

Edit Record Edit Record (login required)