Integrating Neurophysiological Relevance Feedback in Intent Modeling for Information Retrieval

Tools

Jacucci, Giulio; Barral, Oswald; Daee, Pedram; Wenjel, Markus; Serim, Baris; Ruotsalo, Tuukka; Pluchino, Patrik; Freeman, Jonathan; Gamberini, Luciano; Kaski, Samuel and Blankertz, Benjamin. 2019. Integrating Neurophysiological Relevance Feedback in Intent Modeling for Information Retrieval. Journal of the Association for Information Science and Technology, 70(9), pp. 917-930. ISSN 2330-1635 [Article]

Preview

Text
Integrating Neurophysiological Relevance Feedback in Intent Modeling for Information Retrieval_submittedversion2018.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.
Download (1MB) | Preview

Official URL: https://doi.org/10.1002/asi.24161

Abstract or Description

The use of implicit relevance feedback from neurophysiology could deliver effortless information retrieval. However, both computing neurophysiological responses and retrieving documents are characterized by uncertainty due to noisy signals and incomplete or inconsistent representations of the data. We present the first-of-its-kind, fully integrated information retrieval system that makes use of online implicit relevance feedback generated from brain activity as measured through electroencephalography (EEG), and eye movements. The findings of the evaluation experiment (N = 16) show
that we are able to compute online neurophysiology-based r elevance feedback with performance significantly better than chance in complex data domains and realistic search tasks. We contribute by demonstrating how to integrate in interactive intent
modeling this inherently noisy implicit relevance feedback combined with scarce explicit feedback. While experimental measures of task performance did not allow us to demonstrate how the classification outcomes translated into search task performance, the experiment proved that our approach is able to generate relevance feedback from brain signals and eye movements in a realistic scenario, thus providing promising implications for future work in neuroadaptive information retrieval (IR).

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.1002/asi.24161

Additional Information:

This work has been supported by the European Commision (MindSee FP7-ICT; Grant Agreement #611570).

Keywords:

Information retrieval, Brain-computer interfaces, Neuro-physiology, Interactive intent modeling, Relevance feedback

Departments, Centres and Research Units:

Psychology

Dates: