Impacts of time constraints and system delays on user experience

Anita Crescenzi, Diane Kelly, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

21 Citations (Scopus)

Abstract

During information search, people often experience time pressure. This might be a result of a deadline, the system's performance or some other event. In this paper, we report results of a study with forty-five participants which investigated how time constraints and system delays impacted the user experience during information search. We randomly assigned half of our study participants to a treatment condition where they were only allowed five minutes per search task (the other half were given no time limits). For half of participants' search tasks, five second delays were introduced after queries were submitted and SERP results were clicked. We used multilevel modeling to evaluate a number of hypotheses about the effects of time constraint, system delays and user experience. We found those in the time constraint condition reported significantly greater time pressure, experienced higher task difficulty, less satisfaction with their performance, increased importance of working fast and engaged in more metacognitive monitoring. We found when experiencing system delays participants reported slower system speeds when encountering delays on the second task. This work opens a new line of inquiry into how time pressure impacts the search experience and how tools and interfaces might be designed to support people who are searching under time pressure. It also presents an example of how multilevel modeling can be used to better understand and model the complex interactions that occur during interactive information retrieval.
LanguageEnglish
Title of host publicationCHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval
Place of PublicationNew York, NY, USA
Pages141-150
Number of pages10
DOIs
Publication statusPublished - 13 Mar 2016
Externally publishedYes

Fingerprint

experience
time experience
time
information retrieval
performance
monitoring
event
interaction

Keywords

  • search experience
  • time pressure
  • system delays

Cite this

Crescenzi, A., Kelly, D., & Azzopardi, L. (2016). Impacts of time constraints and system delays on user experience. In CHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval (pp. 141-150). New York, NY, USA. https://doi.org/10.1145/2854946.2854976
Crescenzi, Anita ; Kelly, Diane ; Azzopardi, Leif. / Impacts of time constraints and system delays on user experience. CHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. New York, NY, USA, 2016. pp. 141-150
@inproceedings{9aa999fe38e243749842e67b2945ac01,
title = "Impacts of time constraints and system delays on user experience",
abstract = "During information search, people often experience time pressure. This might be a result of a deadline, the system's performance or some other event. In this paper, we report results of a study with forty-five participants which investigated how time constraints and system delays impacted the user experience during information search. We randomly assigned half of our study participants to a treatment condition where they were only allowed five minutes per search task (the other half were given no time limits). For half of participants' search tasks, five second delays were introduced after queries were submitted and SERP results were clicked. We used multilevel modeling to evaluate a number of hypotheses about the effects of time constraint, system delays and user experience. We found those in the time constraint condition reported significantly greater time pressure, experienced higher task difficulty, less satisfaction with their performance, increased importance of working fast and engaged in more metacognitive monitoring. We found when experiencing system delays participants reported slower system speeds when encountering delays on the second task. This work opens a new line of inquiry into how time pressure impacts the search experience and how tools and interfaces might be designed to support people who are searching under time pressure. It also presents an example of how multilevel modeling can be used to better understand and model the complex interactions that occur during interactive information retrieval.",
keywords = "search experience, time pressure, system delays",
author = "Anita Crescenzi and Diane Kelly and Leif Azzopardi",
year = "2016",
month = "3",
day = "13",
doi = "10.1145/2854946.2854976",
language = "English",
isbn = "978-1-4503-3751-9",
pages = "141--150",
booktitle = "CHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval",

}

Crescenzi, A, Kelly, D & Azzopardi, L 2016, Impacts of time constraints and system delays on user experience. in CHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. New York, NY, USA, pp. 141-150. https://doi.org/10.1145/2854946.2854976

Impacts of time constraints and system delays on user experience. / Crescenzi, Anita; Kelly, Diane; Azzopardi, Leif.

CHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. New York, NY, USA, 2016. p. 141-150.

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

TY - GEN

T1 - Impacts of time constraints and system delays on user experience

AU - Crescenzi, Anita

AU - Kelly, Diane

AU - Azzopardi, Leif

PY - 2016/3/13

Y1 - 2016/3/13

N2 - During information search, people often experience time pressure. This might be a result of a deadline, the system's performance or some other event. In this paper, we report results of a study with forty-five participants which investigated how time constraints and system delays impacted the user experience during information search. We randomly assigned half of our study participants to a treatment condition where they were only allowed five minutes per search task (the other half were given no time limits). For half of participants' search tasks, five second delays were introduced after queries were submitted and SERP results were clicked. We used multilevel modeling to evaluate a number of hypotheses about the effects of time constraint, system delays and user experience. We found those in the time constraint condition reported significantly greater time pressure, experienced higher task difficulty, less satisfaction with their performance, increased importance of working fast and engaged in more metacognitive monitoring. We found when experiencing system delays participants reported slower system speeds when encountering delays on the second task. This work opens a new line of inquiry into how time pressure impacts the search experience and how tools and interfaces might be designed to support people who are searching under time pressure. It also presents an example of how multilevel modeling can be used to better understand and model the complex interactions that occur during interactive information retrieval.

AB - During information search, people often experience time pressure. This might be a result of a deadline, the system's performance or some other event. In this paper, we report results of a study with forty-five participants which investigated how time constraints and system delays impacted the user experience during information search. We randomly assigned half of our study participants to a treatment condition where they were only allowed five minutes per search task (the other half were given no time limits). For half of participants' search tasks, five second delays were introduced after queries were submitted and SERP results were clicked. We used multilevel modeling to evaluate a number of hypotheses about the effects of time constraint, system delays and user experience. We found those in the time constraint condition reported significantly greater time pressure, experienced higher task difficulty, less satisfaction with their performance, increased importance of working fast and engaged in more metacognitive monitoring. We found when experiencing system delays participants reported slower system speeds when encountering delays on the second task. This work opens a new line of inquiry into how time pressure impacts the search experience and how tools and interfaces might be designed to support people who are searching under time pressure. It also presents an example of how multilevel modeling can be used to better understand and model the complex interactions that occur during interactive information retrieval.

KW - search experience

KW - time pressure

KW - system delays

U2 - 10.1145/2854946.2854976

DO - 10.1145/2854946.2854976

M3 - Conference contribution book

SN - 978-1-4503-3751-9

SP - 141

EP - 150

BT - CHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval

CY - New York, NY, USA

ER -

Crescenzi A, Kelly D, Azzopardi L. Impacts of time constraints and system delays on user experience. In CHIIR '16 Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. New York, NY, USA. 2016. p. 141-150 https://doi.org/10.1145/2854946.2854976