Exploring the query halo effect in site search: leading people to longer queries

Djoerd Hiemstra, Claudia Hau, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

26 Downloads (Pure)

Abstract

People tend to type short queries, however, the belief is that longer queries are more effective. Consequently, a number of attempts have been made to encourage and motivate people to enter longer queries. While most have failed, a recent attempt - conducted in a laboratory setup - in which the query box has a halo or glow effect, that changes as the query becomes longer, has been shown to increase query length by one term, on average. In this paper, we test whether a similar increase is observed when the same component is deployed in a production system for site search and used by real end users. To this end, we conducted two separate experiments, where the rate at which the color changes in the halo were varied. In both experiments users were assigned to one of two conditions: halo and no-halo. The experiments were ran over a fifty day period with 3,506 unique users submitting over six thousand queries. In both experiments, however, we observed no significant difference in query length. We also did not find longer queries to result in greater retrieval performance. While, we did not reproduce the previous findings, our results indicate that the query halo effect appears to be sensitive to performance and task, limiting its applicability to other contexts.

Original languageEnglish
Title of host publicationSIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval
Place of PublicationNew York, NY
Pages981-984
Number of pages4
ISBN (Electronic)9781450350228
DOIs
Publication statusPublished - 7 Aug 2017
Event40th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2017 - Tokyo, Shinjuku, Japan
Duration: 7 Aug 201711 Aug 2017

Conference

Conference40th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2017
CountryJapan
CityTokyo, Shinjuku
Period7/08/1711/08/17

Keywords

  • A/B testing
  • halo
  • query length
  • research replication

Fingerprint Dive into the research topics of 'Exploring the query halo effect in site search: leading people to longer queries'. Together they form a unique fingerprint.

Cite this