Exploring behavioral dimensions in session effectiveness

Teemu Pääkkönen, Kalervo Järvelin, Jaana Kekäläinen, Heikki Keskustalo, Feza Baskaya, David Maxwell, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

4 Citations (Scopus)

Abstract

Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.
LanguageEnglish
Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction
Subtitle of host publication6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings
EditorsJosiane Mothe, Jacques Savoy, Jaap Kamps, Karen Pinel-Sauvagnat, Gareth J.F. Jones, Eric SanJuan, Linda Cappellato, Nicola Ferro
Place of PublicationNew York, NY.
Pages178-189
Number of pages12
DOIs
Publication statusPublished - 20 Nov 2015
Event6th International Conference of the CLEF Association, CLEF'15 - Toulouse, France
Duration: 8 Sep 201511 Sep 2015
http://clef2015.clef-initiative.eu/

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume9283
ISSN (Print)0302-9743

Conference

Conference6th International Conference of the CLEF Association, CLEF'15
CountryFrance
CityToulouse
Period8/09/1511/09/15
Internet address

Fingerprint

Information retrieval
Costs

Keywords

  • behavioral dimensions
  • IR interaction
  • multi-query scanning models
  • session-based evaluation
  • simulation

Cite this

Pääkkönen, T., Järvelin, K., Kekäläinen, J., Keskustalo, H., Baskaya, F., Maxwell, D., & Azzopardi, L. (2015). Exploring behavioral dimensions in session effectiveness. In J. Mothe, J. Savoy, J. Kamps, K. Pinel-Sauvagnat, G. J. F. Jones, E. SanJuan, L. Cappellato, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings (pp. 178-189). (Lecture Notes in Computer Science; Vol. 9283). New York, NY.. https://doi.org/10.1007/978-3-319-24027-5_15
Pääkkönen, Teemu ; Järvelin, Kalervo ; Kekäläinen, Jaana ; Keskustalo, Heikki ; Baskaya, Feza ; Maxwell, David ; Azzopardi, Leif. / Exploring behavioral dimensions in session effectiveness. Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. editor / Josiane Mothe ; Jacques Savoy ; Jaap Kamps ; Karen Pinel-Sauvagnat ; Gareth J.F. Jones ; Eric SanJuan ; Linda Cappellato ; Nicola Ferro. New York, NY., 2015. pp. 178-189 (Lecture Notes in Computer Science).
@inproceedings{ef142e0221bc4e3a9a941f82e77a2b30,
title = "Exploring behavioral dimensions in session effectiveness",
abstract = "Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.",
keywords = "behavioral dimensions , IR interaction, multi-query scanning models, session-based evaluation, simulation",
author = "Teemu P{\"a}{\"a}kk{\"o}nen and Kalervo J{\"a}rvelin and Jaana Kek{\"a}l{\"a}inen and Heikki Keskustalo and Feza Baskaya and David Maxwell and Leif Azzopardi",
year = "2015",
month = "11",
day = "20",
doi = "10.1007/978-3-319-24027-5_15",
language = "English",
isbn = "9783319240268",
series = "Lecture Notes in Computer Science",
publisher = "Springer",
pages = "178--189",
editor = "Josiane Mothe and Jacques Savoy and Jaap Kamps and Karen Pinel-Sauvagnat and Jones, {Gareth J.F.} and Eric SanJuan and Linda Cappellato and Nicola Ferro",
booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction",

}

Pääkkönen, T, Järvelin, K, Kekäläinen, J, Keskustalo, H, Baskaya, F, Maxwell, D & Azzopardi, L 2015, Exploring behavioral dimensions in session effectiveness. in J Mothe, J Savoy, J Kamps, K Pinel-Sauvagnat, GJF Jones, E SanJuan, L Cappellato & N Ferro (eds), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. Lecture Notes in Computer Science, vol. 9283, New York, NY., pp. 178-189, 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, 8/09/15. https://doi.org/10.1007/978-3-319-24027-5_15

Exploring behavioral dimensions in session effectiveness. / Pääkkönen, Teemu; Järvelin, Kalervo; Kekäläinen, Jaana; Keskustalo, Heikki; Baskaya, Feza; Maxwell, David; Azzopardi, Leif.

Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. ed. / Josiane Mothe; Jacques Savoy; Jaap Kamps; Karen Pinel-Sauvagnat; Gareth J.F. Jones; Eric SanJuan; Linda Cappellato; Nicola Ferro. New York, NY., 2015. p. 178-189 (Lecture Notes in Computer Science; Vol. 9283).

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

TY - GEN

T1 - Exploring behavioral dimensions in session effectiveness

AU - Pääkkönen, Teemu

AU - Järvelin, Kalervo

AU - Kekäläinen, Jaana

AU - Keskustalo, Heikki

AU - Baskaya, Feza

AU - Maxwell, David

AU - Azzopardi, Leif

PY - 2015/11/20

Y1 - 2015/11/20

N2 - Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.

AB - Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.

KW - behavioral dimensions

KW - IR interaction

KW - multi-query scanning models

KW - session-based evaluation

KW - simulation

UR - http://link.springer.com/book/10.1007/978-3-319-24027-5

U2 - 10.1007/978-3-319-24027-5_15

DO - 10.1007/978-3-319-24027-5_15

M3 - Conference contribution book

SN - 9783319240268

T3 - Lecture Notes in Computer Science

SP - 178

EP - 189

BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction

A2 - Mothe, Josiane

A2 - Savoy, Jacques

A2 - Kamps, Jaap

A2 - Pinel-Sauvagnat, Karen

A2 - Jones, Gareth J.F.

A2 - SanJuan, Eric

A2 - Cappellato, Linda

A2 - Ferro, Nicola

CY - New York, NY.

ER -

Pääkkönen T, Järvelin K, Kekäläinen J, Keskustalo H, Baskaya F, Maxwell D et al. Exploring behavioral dimensions in session effectiveness. In Mothe J, Savoy J, Kamps J, Pinel-Sauvagnat K, Jones GJF, SanJuan E, Cappellato L, Ferro N, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. New York, NY. 2015. p. 178-189. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-319-24027-5_15