Abstract
Perceptual Speed (PS) is a cognitive ability defined by an individual’s accuracy and speed to scan information while completing visual search tasks. Prior studies using PS tests have demonstrated that PS affects multiple factors in Information Retrieval (IR), such as a user’s search performance, interaction with the system, time spent completing tasks, and subjective impression of their workload. With greater knowledge of PS, systems could be designed that accommodate users with low PS to improve their overall search experience. However, in this perspectives paper, we analyse how PS tests have been used in IR, and identify multiple uncertainties regarding PS content, administration, analysis, and reporting of findings. Consequently, we aim to stir discussion between IR researchers by drawing awareness to these issues. As a result, we further discuss challenges involved in advancing how future PS tests are used in IR. Finally, we propose recommendations that have the potential for enhancing the reliability and validity of current PS tests.
Original language | English |
---|---|
Title of host publication | CHIIR '20: Proceedings of the 2020 Conference on Human Information Interaction and Retrieval |
Place of Publication | New York |
Pages | 234-242 |
Number of pages | 9 |
DOIs | |
Publication status | Published - 18 Mar 2020 |
Event | ACM SIGIR Conference on Human Information Interaction and Retrieval - Vancouver, Canada Duration: 14 Mar 2020 → 18 Mar 2020 Conference number: 5 |
Conference
Conference | ACM SIGIR Conference on Human Information Interaction and Retrieval |
---|---|
Abbreviated title | CHIIR |
Country/Territory | Canada |
City | Vancouver |
Period | 14/03/20 → 18/03/20 |
Keywords
- information retrieval
- information retrieval speed
- speed tests
Fingerprint
Dive into the research topics of 'Reflecting upon perceptual speed tests in information retrieval: limitations, challenges, and recommendations'. Together they form a unique fingerprint.Prizes
-
Best Paper Award ACM CHIIR 2020
Foulds, O. (Recipient), Azzopardi, L. (Recipient) & Halvey, M. (Recipient), Mar 2020
Prize: National/international honour