Report on the SIGIR 2010 workshop on the simulation of interaction

Leif Azzopardi, Kalervo Järvelin, Jaap Kamps, Mark D. Smucker

Research output: Contribution to journalArticle

Abstract

All search in the real-world is inherently interactive. Information retrieval (IR) has a firm tradition of using simulation to evaluate IR systems as embodied by the Cranfield paradigm. However, to a large extent, such system evaluations ignore user interaction. Simulations provide a way to go beyond this limitation. With an increasing number of researchers using simulation to evaluate interactive IR systems, it is now timely to discuss, develop and advance this powerful methodology within the field of IR. During the SimInt 2010 workshop around 40 participants discussed and presented their views on the simulation of interaction. The main conclusion and general consensus was that simulation offers great potential for the field of IR; and that simulations of user interaction can make explicit the user and the user interface while maintaining the advantages of the Cranfield paradigm.
LanguageEnglish
Pages35-47
Number of pages13
JournalACM SIGIR Forum
Volume44
Issue number2
DOIs
Publication statusPublished - 1 Dec 2010
Externally publishedYes

Fingerprint

Information retrieval
Information retrieval systems
User interfaces
Simulation
Interaction

Keywords

  • information retrieval
  • Cranfield paradigm

Cite this

Azzopardi, Leif ; Järvelin, Kalervo ; Kamps, Jaap ; Smucker, Mark D. / Report on the SIGIR 2010 workshop on the simulation of interaction. In: ACM SIGIR Forum. 2010 ; Vol. 44, No. 2. pp. 35-47.
@article{8e4068d338f04d7cb301cd48684b2b04,
title = "Report on the SIGIR 2010 workshop on the simulation of interaction",
abstract = "All search in the real-world is inherently interactive. Information retrieval (IR) has a firm tradition of using simulation to evaluate IR systems as embodied by the Cranfield paradigm. However, to a large extent, such system evaluations ignore user interaction. Simulations provide a way to go beyond this limitation. With an increasing number of researchers using simulation to evaluate interactive IR systems, it is now timely to discuss, develop and advance this powerful methodology within the field of IR. During the SimInt 2010 workshop around 40 participants discussed and presented their views on the simulation of interaction. The main conclusion and general consensus was that simulation offers great potential for the field of IR; and that simulations of user interaction can make explicit the user and the user interface while maintaining the advantages of the Cranfield paradigm.",
keywords = "information retrieval, Cranfield paradigm",
author = "Leif Azzopardi and Kalervo J{\"a}rvelin and Jaap Kamps and Smucker, {Mark D.}",
year = "2010",
month = "12",
day = "1",
doi = "10.1145/1924475.1924484",
language = "English",
volume = "44",
pages = "35--47",
journal = "ACM SIGIR Forum",
issn = "1558-0229",
number = "2",

}

Report on the SIGIR 2010 workshop on the simulation of interaction. / Azzopardi, Leif; Järvelin, Kalervo; Kamps, Jaap; Smucker, Mark D.

In: ACM SIGIR Forum, Vol. 44, No. 2, 01.12.2010, p. 35-47.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Report on the SIGIR 2010 workshop on the simulation of interaction

AU - Azzopardi, Leif

AU - Järvelin, Kalervo

AU - Kamps, Jaap

AU - Smucker, Mark D.

PY - 2010/12/1

Y1 - 2010/12/1

N2 - All search in the real-world is inherently interactive. Information retrieval (IR) has a firm tradition of using simulation to evaluate IR systems as embodied by the Cranfield paradigm. However, to a large extent, such system evaluations ignore user interaction. Simulations provide a way to go beyond this limitation. With an increasing number of researchers using simulation to evaluate interactive IR systems, it is now timely to discuss, develop and advance this powerful methodology within the field of IR. During the SimInt 2010 workshop around 40 participants discussed and presented their views on the simulation of interaction. The main conclusion and general consensus was that simulation offers great potential for the field of IR; and that simulations of user interaction can make explicit the user and the user interface while maintaining the advantages of the Cranfield paradigm.

AB - All search in the real-world is inherently interactive. Information retrieval (IR) has a firm tradition of using simulation to evaluate IR systems as embodied by the Cranfield paradigm. However, to a large extent, such system evaluations ignore user interaction. Simulations provide a way to go beyond this limitation. With an increasing number of researchers using simulation to evaluate interactive IR systems, it is now timely to discuss, develop and advance this powerful methodology within the field of IR. During the SimInt 2010 workshop around 40 participants discussed and presented their views on the simulation of interaction. The main conclusion and general consensus was that simulation offers great potential for the field of IR; and that simulations of user interaction can make explicit the user and the user interface while maintaining the advantages of the Cranfield paradigm.

KW - information retrieval

KW - Cranfield paradigm

U2 - 10.1145/1924475.1924484

DO - 10.1145/1924475.1924484

M3 - Article

VL - 44

SP - 35

EP - 47

JO - ACM SIGIR Forum

T2 - ACM SIGIR Forum

JF - ACM SIGIR Forum

SN - 1558-0229

IS - 2

ER -