Simulating interactive information retrieval: SimIIR: a framework for the simulation of interaction

David Maxwell, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

3 Citations (Scopus)

Abstract

Simulation provides a powerful and cost-effective approach to explore and evaluate how interactions between a searcher and system influence search behaviour and performance. With a growing interest in simulation and an increasing number of papers using such an approach, there is a need for a flexible framework for simulation. Thus, we present SimIIR, an open-source toolkit for building and conducting Interactive Information Retrieval (IIR) experiments. The framework consists of a number of high level components, including the simulation, the searcher and the system, all of which must be configured. The SimIIR framework provides a series of interchangeable components. Examples of these components include the querying strategies (how simulated queries are formulated) and stopping strategies (the depth to which a searcher will examine snippets and documents) that a simulated searcher will employ. We have implemented various existing strategies so that they can be used by other researchers to not only replicate and reproduce past experiments, but also create new experiments. This paper describes the SimIIR framework and the different components that can be configured and extended as required.
Original languageEnglish
Title of host publicationSIGIR '16 Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval
Place of PublicationNew York, NY, USA
Pages1141-1144
Number of pages4
DOIs
Publication statusPublished - 7 Jul 2016
Externally publishedYes

Keywords

  • continuation strategies
  • user modeling
  • stopping strategies
  • search behaviour
  • querying strategies

Cite this

Maxwell, D., & Azzopardi, L. (2016). Simulating interactive information retrieval: SimIIR: a framework for the simulation of interaction. In SIGIR '16 Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1141-1144). https://doi.org/10.1145/2911451.2911469