When relevance judgement is happening?: an EEG-based study

Marco Allegretti, Yashar Moshfeghi, Maria Hadjigeorgieva, Frank E. Pollick, Joemon M. Jose, Gabriella Pasi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

12 Citations (Scopus)

Abstract

Relevance is a central notion in Information Retrieval, but it is considered to be a difficult concept to define. We analyse brain signals for the first 800 milliseconds (ms) of a relevance assessment process to answer the question "when relevance is happening in the brain?" with the belief that it will lead to better operational definitions of relevance. For this purpose, we devised a user study in which we captured the brain response of 20 participants. Using a 64-channel EEG device, we measured the electrophysiological activity of the brain while the subjects were in the phase of giving an explicit judgement about the relevance of presented images according to a given topic. Analyses were then performed over different time windows of the recorded EEG signals using repeated measures ANOVA. Data reveal significant variation between relevance and non-relevance within the EEG signals from the presentation of the image to 800 milliseconds afterwards. At an early stage these differences were located at frontal and posterior electrode sites. However, at later stages these differences were located in central, centro-parietal and centro-frontal areas.Our findings are an important step towards (i) a better understanding of the concept of relevance and (ii) a more effective implicit feedback systems.
LanguageEnglish
Title of host publicationProceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval
Place of PublicationNew York, NY
Pages719-722
Number of pages4
DOIs
Publication statusPublished - 9 Aug 2015
Event38th International ACM SIGIR Conference on Research and Development in Information Retrieval - Santiago, Chile
Duration: 9 Aug 201513 Aug 2015

Conference

Conference38th International ACM SIGIR Conference on Research and Development in Information Retrieval
CountryChile
CitySantiago
Period9/08/1513/08/15

Fingerprint

Electroencephalography
Brain
Analysis of variance (ANOVA)
Information retrieval
Feedback
Electrodes

Keywords

  • information retrieval
  • relevance
  • brain response
  • EEG

Cite this

Allegretti, M., Moshfeghi, Y., Hadjigeorgieva, M., Pollick, F. E., Jose, J. M., & Pasi, G. (2015). When relevance judgement is happening? an EEG-based study. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 719-722). New York, NY. https://doi.org/10.1145/2766462.2767811
Allegretti, Marco ; Moshfeghi, Yashar ; Hadjigeorgieva, Maria ; Pollick, Frank E. ; Jose, Joemon M. ; Pasi, Gabriella. / When relevance judgement is happening? an EEG-based study. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, NY, 2015. pp. 719-722
@inproceedings{596c03372fba4816a60db64f94a2473b,
title = "When relevance judgement is happening?: an EEG-based study",
abstract = "Relevance is a central notion in Information Retrieval, but it is considered to be a difficult concept to define. We analyse brain signals for the first 800 milliseconds (ms) of a relevance assessment process to answer the question {"}when relevance is happening in the brain?{"} with the belief that it will lead to better operational definitions of relevance. For this purpose, we devised a user study in which we captured the brain response of 20 participants. Using a 64-channel EEG device, we measured the electrophysiological activity of the brain while the subjects were in the phase of giving an explicit judgement about the relevance of presented images according to a given topic. Analyses were then performed over different time windows of the recorded EEG signals using repeated measures ANOVA. Data reveal significant variation between relevance and non-relevance within the EEG signals from the presentation of the image to 800 milliseconds afterwards. At an early stage these differences were located at frontal and posterior electrode sites. However, at later stages these differences were located in central, centro-parietal and centro-frontal areas.Our findings are an important step towards (i) a better understanding of the concept of relevance and (ii) a more effective implicit feedback systems.",
keywords = "information retrieval, relevance, brain response, EEG",
author = "Marco Allegretti and Yashar Moshfeghi and Maria Hadjigeorgieva and Pollick, {Frank E.} and Jose, {Joemon M.} and Gabriella Pasi",
year = "2015",
month = "8",
day = "9",
doi = "10.1145/2766462.2767811",
language = "English",
isbn = "9781450336215",
pages = "719--722",
booktitle = "Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval",

}

Allegretti, M, Moshfeghi, Y, Hadjigeorgieva, M, Pollick, FE, Jose, JM & Pasi, G 2015, When relevance judgement is happening? an EEG-based study. in Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, NY, pp. 719-722, 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, 9/08/15. https://doi.org/10.1145/2766462.2767811

When relevance judgement is happening? an EEG-based study. / Allegretti, Marco; Moshfeghi, Yashar; Hadjigeorgieva, Maria; Pollick, Frank E.; Jose, Joemon M.; Pasi, Gabriella.

Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, NY, 2015. p. 719-722.

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

TY - GEN

T1 - When relevance judgement is happening?

T2 - an EEG-based study

AU - Allegretti, Marco

AU - Moshfeghi, Yashar

AU - Hadjigeorgieva, Maria

AU - Pollick, Frank E.

AU - Jose, Joemon M.

AU - Pasi, Gabriella

PY - 2015/8/9

Y1 - 2015/8/9

N2 - Relevance is a central notion in Information Retrieval, but it is considered to be a difficult concept to define. We analyse brain signals for the first 800 milliseconds (ms) of a relevance assessment process to answer the question "when relevance is happening in the brain?" with the belief that it will lead to better operational definitions of relevance. For this purpose, we devised a user study in which we captured the brain response of 20 participants. Using a 64-channel EEG device, we measured the electrophysiological activity of the brain while the subjects were in the phase of giving an explicit judgement about the relevance of presented images according to a given topic. Analyses were then performed over different time windows of the recorded EEG signals using repeated measures ANOVA. Data reveal significant variation between relevance and non-relevance within the EEG signals from the presentation of the image to 800 milliseconds afterwards. At an early stage these differences were located at frontal and posterior electrode sites. However, at later stages these differences were located in central, centro-parietal and centro-frontal areas.Our findings are an important step towards (i) a better understanding of the concept of relevance and (ii) a more effective implicit feedback systems.

AB - Relevance is a central notion in Information Retrieval, but it is considered to be a difficult concept to define. We analyse brain signals for the first 800 milliseconds (ms) of a relevance assessment process to answer the question "when relevance is happening in the brain?" with the belief that it will lead to better operational definitions of relevance. For this purpose, we devised a user study in which we captured the brain response of 20 participants. Using a 64-channel EEG device, we measured the electrophysiological activity of the brain while the subjects were in the phase of giving an explicit judgement about the relevance of presented images according to a given topic. Analyses were then performed over different time windows of the recorded EEG signals using repeated measures ANOVA. Data reveal significant variation between relevance and non-relevance within the EEG signals from the presentation of the image to 800 milliseconds afterwards. At an early stage these differences were located at frontal and posterior electrode sites. However, at later stages these differences were located in central, centro-parietal and centro-frontal areas.Our findings are an important step towards (i) a better understanding of the concept of relevance and (ii) a more effective implicit feedback systems.

KW - information retrieval

KW - relevance

KW - brain response

KW - EEG

UR - https://dl.acm.org

U2 - 10.1145/2766462.2767811

DO - 10.1145/2766462.2767811

M3 - Conference contribution book

SN - 9781450336215

SP - 719

EP - 722

BT - Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval

CY - New York, NY

ER -

Allegretti M, Moshfeghi Y, Hadjigeorgieva M, Pollick FE, Jose JM, Pasi G. When relevance judgement is happening? an EEG-based study. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, NY. 2015. p. 719-722 https://doi.org/10.1145/2766462.2767811