Exploring behavioral dimensions in session effectiveness

Teemu Pääkkönen; Kalervo Järvelin; Jaana Kekäläinen; Heikki Keskustalo; Feza Baskaya; David Maxwell; Leif Azzopardi

doi:10.1007/978-3-319-24027-5_15

Exploring behavioral dimensions in session effectiveness

Teemu Pääkkönen, Kalervo Järvelin, Jaana Kekäläinen, Heikki Keskustalo, Feza Baskaya, David Maxwell, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution book

5 Citations (Scopus)

Abstract

Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.

Original language	English
Title of host publication	Experimental IR Meets Multilinguality, Multimodality, and Interaction
Subtitle of host publication	6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings
Editors	Josiane Mothe, Jacques Savoy, Jaap Kamps, Karen Pinel-Sauvagnat, Gareth J.F. Jones, Eric SanJuan, Linda Cappellato, Nicola Ferro
Place of Publication	New York, NY.
Publisher	Springer International Publishing AG
Pages	178-189
Number of pages	12
ISBN (Print)	9783319240268
DOIs	https://doi.org/10.1007/978-3-319-24027-5_15
Publication status	Published - 20 Nov 2015
Event	6th International Conference of the CLEF Association, CLEF'15 - Toulouse, France Duration: 8 Sept 2015 → 11 Sept 2015 http://clef2015.clef-initiative.eu/

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	9283
ISSN (Print)	0302-9743

Conference

Conference	6th International Conference of the CLEF Association, CLEF'15
Country/Territory	France
City	Toulouse
Period	8/09/15 → 11/09/15
Internet address	http://clef2015.clef-initiative.eu/

Keywords

behavioral dimensions
IR interaction
multi-query scanning models
session-based evaluation
simulation

Access to Document

10.1007/978-3-319-24027-5_15

Cite this

Pääkkönen, T., Järvelin, K., Kekäläinen, J., Keskustalo, H., Baskaya, F., Maxwell, D., & Azzopardi, L. (2015). Exploring behavioral dimensions in session effectiveness. In J. Mothe, J. Savoy, J. Kamps, K. Pinel-Sauvagnat, G. J. F. Jones, E. SanJuan, L. Cappellato, & N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings (pp. 178-189). (Lecture Notes in Computer Science; Vol. 9283). Springer International Publishing AG. https://doi.org/10.1007/978-3-319-24027-5_15

Pääkkönen, Teemu ; Järvelin, Kalervo ; Kekäläinen, Jaana et al. / Exploring behavioral dimensions in session effectiveness. Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. editor / Josiane Mothe ; Jacques Savoy ; Jaap Kamps ; Karen Pinel-Sauvagnat ; Gareth J.F. Jones ; Eric SanJuan ; Linda Cappellato ; Nicola Ferro. New York, NY. : Springer International Publishing AG, 2015. pp. 178-189 (Lecture Notes in Computer Science).

@inproceedings{ef142e0221bc4e3a9a941f82e77a2b30,

title = "Exploring behavioral dimensions in session effectiveness",

abstract = "Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.",

keywords = "behavioral dimensions , IR interaction, multi-query scanning models, session-based evaluation, simulation",

author = "Teemu P{\"a}{\"a}kk{\"o}nen and Kalervo J{\"a}rvelin and Jaana Kek{\"a}l{\"a}inen and Heikki Keskustalo and Feza Baskaya and David Maxwell and Leif Azzopardi",

year = "2015",

month = nov,

day = "20",

doi = "10.1007/978-3-319-24027-5_15",

language = "English",

isbn = "9783319240268",

series = "Lecture Notes in Computer Science",

publisher = "Springer International Publishing AG",

pages = "178--189",

editor = "Josiane Mothe and Jacques Savoy and Jaap Kamps and Karen Pinel-Sauvagnat and Jones, {Gareth J.F.} and Eric SanJuan and Linda Cappellato and Nicola Ferro",

booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction",

address = "Switzerland",

note = "6th International Conference of the CLEF Association, CLEF'15 ; Conference date: 08-09-2015 Through 11-09-2015",

url = "http://clef2015.clef-initiative.eu/",

}

Pääkkönen, T, Järvelin, K, Kekäläinen, J, Keskustalo, H, Baskaya, F, Maxwell, D & Azzopardi, L 2015, Exploring behavioral dimensions in session effectiveness. in J Mothe, J Savoy, J Kamps, K Pinel-Sauvagnat, GJF Jones, E SanJuan, L Cappellato & N Ferro (eds), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. Lecture Notes in Computer Science, vol. 9283, Springer International Publishing AG, New York, NY., pp. 178-189, 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, 8/09/15. https://doi.org/10.1007/978-3-319-24027-5_15

Exploring behavioral dimensions in session effectiveness. / Pääkkönen, Teemu; Järvelin, Kalervo; Kekäläinen, Jaana et al.
Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. ed. / Josiane Mothe; Jacques Savoy; Jaap Kamps; Karen Pinel-Sauvagnat; Gareth J.F. Jones; Eric SanJuan; Linda Cappellato; Nicola Ferro. New York, NY.: Springer International Publishing AG, 2015. p. 178-189 (Lecture Notes in Computer Science; Vol. 9283).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution book

TY - GEN

T1 - Exploring behavioral dimensions in session effectiveness

AU - Pääkkönen, Teemu

AU - Järvelin, Kalervo

AU - Kekäläinen, Jaana

AU - Keskustalo, Heikki

AU - Baskaya, Feza

AU - Maxwell, David

AU - Azzopardi, Leif

PY - 2015/11/20

Y1 - 2015/11/20

N2 - Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.

AB - Studies in interactive information retrieval (IIR) indicate that expert searchers differ from novices in many ways. In the present paper, we identify a number of behavioral dimensions along which searchers differ (e.g. cost, gain and the accuracy of relevance assessment). We quantify these differences using simulated, multi-query search sessions. We then explore each dimension in turn to determine what differences are most effective in yielding superior retrieval performance. The more precise action probabilities in assessing snippets and documents contribute less to the overall cumulative gain during a session than gain and cost structures.

KW - behavioral dimensions

KW - IR interaction

KW - multi-query scanning models

KW - session-based evaluation

KW - simulation

UR - http://link.springer.com/book/10.1007/978-3-319-24027-5

U2 - 10.1007/978-3-319-24027-5_15

DO - 10.1007/978-3-319-24027-5_15

M3 - Conference contribution book

SN - 9783319240268

T3 - Lecture Notes in Computer Science

SP - 178

EP - 189

BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction

A2 - Mothe, Josiane

A2 - Savoy, Jacques

A2 - Kamps, Jaap

A2 - Pinel-Sauvagnat, Karen

A2 - Jones, Gareth J.F.

A2 - SanJuan, Eric

A2 - Cappellato, Linda

A2 - Ferro, Nicola

PB - Springer International Publishing AG

CY - New York, NY.

T2 - 6th International Conference of the CLEF Association, CLEF'15

Y2 - 8 September 2015 through 11 September 2015

ER -

Pääkkönen T, Järvelin K, Kekäläinen J, Keskustalo H, Baskaya F, Maxwell D et al. Exploring behavioral dimensions in session effectiveness. In Mothe J, Savoy J, Kamps J, Pinel-Sauvagnat K, Jones GJF, SanJuan E, Cappellato L, Ferro N, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction: 6th International Conference of the CLEF Association, CLEF'15, Toulouse, France, September 8-11, 2015, Proceedings. New York, NY.: Springer International Publishing AG. 2015. p. 178-189. (Lecture Notes in Computer Science). doi: 10.1007/978-3-319-24027-5_15

Exploring behavioral dimensions in session effectiveness

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this