Reflecting upon perceptual speed tests in information retrieval: limitations, challenges, and recommendations

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

1 Citation (Scopus)
14 Downloads (Pure)

Abstract

Perceptual Speed (PS) is a cognitive ability defined by an individual’s accuracy and speed to scan information while completing visual search tasks. Prior studies using PS tests have demonstrated that PS affects multiple factors in Information Retrieval (IR), such as a user’s search performance, interaction with the system, time spent completing tasks, and subjective impression of their workload. With greater knowledge of PS, systems could be designed that accommodate users with low PS to improve their overall search experience. However, in this perspectives paper, we analyse how PS tests have been used in IR, and identify multiple uncertainties regarding PS content, administration, analysis, and reporting of findings. Consequently, we aim to stir discussion between IR researchers by drawing awareness to these issues. As a result, we further discuss challenges involved in advancing how future PS tests are used in IR. Finally, we propose recommendations that have the potential for enhancing the reliability and validity of current PS tests.
Original languageEnglish
Title of host publicationCHIIR '20: Proceedings of the 2020 Conference on Human Information Interaction and Retrieval
Place of PublicationNew York
Pages234-242
Number of pages9
DOIs
Publication statusPublished - 18 Mar 2020
EventACM SIGIR Conference on Human Information Interaction and Retrieval - Vancouver, Canada
Duration: 14 Mar 202018 Mar 2020
Conference number: 5

Conference

ConferenceACM SIGIR Conference on Human Information Interaction and Retrieval
Abbreviated titleCHIIR
CountryCanada
CityVancouver
Period14/03/2018/03/20

Keywords

  • information retrieval
  • information retrieval speed
  • speed tests

Prizes

Best Paper Award ACM CHIIR 2020

Foulds, Olivia (Recipient), Azzopardi, Leif (Recipient) & Halvey, Martin (Recipient), Mar 2020

Prize: National/international honour

Cite this