How many results per page?: a study of SERP size, search behavior and user experience

Diane Kelly, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

25 Citations (Scopus)

Abstract

The provision of "ten blue links" has emerged as the standard for the design of search engine result pages (SERPs). While numerous aspects of SERPs have been examined, little attention has been paid to the number of results displayed per page. This paper investigates the relationships among the number of results shown on a SERP, search behavior and user experience. We performed a laboratory experiment with 36 subjects, who were randomly assigned to use one of three search interfaces that varied according to the number of results per SERP (three, six or ten). We found subjects' click distributions differed significantly depending on SERP size. We also found those who interacted with three results per page viewed significantly more SERPs per query; interestingly, the number of SERPs they viewed per query corresponded to about 10 search results. Subjects who interacted with ten results per page viewed and saved significantly more documents. They also reported the greatest difficulty finding relevant documents, rated their skills the lowest and reported greater workload, even though these differences were not significant. This work shows that behavior changes with SERP size, such that more time is spent focused on earlier results when SERP size decreases.
LanguageEnglish
Title of host publicationSIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval
Place of PublicationNew York, NY, USA
Pages183-192
Number of pages10
DOIs
Publication statusPublished - 9 Aug 2015
Externally publishedYes

Fingerprint

search engine
experience
laboratory experiment
workload

Keywords

  • search behaviour
  • user studies
  • search result page
  • search interface

Cite this

Kelly, D., & Azzopardi, L. (2015). How many results per page? a study of SERP size, search behavior and user experience. In SIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 183-192). New York, NY, USA. https://doi.org/10.1145/2766462.2767732
Kelly, Diane ; Azzopardi, Leif. / How many results per page? a study of SERP size, search behavior and user experience. SIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval . New York, NY, USA, 2015. pp. 183-192
@inproceedings{2090980abcb34cffbde438d9f1a9157f,
title = "How many results per page?: a study of SERP size, search behavior and user experience",
abstract = "The provision of {"}ten blue links{"} has emerged as the standard for the design of search engine result pages (SERPs). While numerous aspects of SERPs have been examined, little attention has been paid to the number of results displayed per page. This paper investigates the relationships among the number of results shown on a SERP, search behavior and user experience. We performed a laboratory experiment with 36 subjects, who were randomly assigned to use one of three search interfaces that varied according to the number of results per SERP (three, six or ten). We found subjects' click distributions differed significantly depending on SERP size. We also found those who interacted with three results per page viewed significantly more SERPs per query; interestingly, the number of SERPs they viewed per query corresponded to about 10 search results. Subjects who interacted with ten results per page viewed and saved significantly more documents. They also reported the greatest difficulty finding relevant documents, rated their skills the lowest and reported greater workload, even though these differences were not significant. This work shows that behavior changes with SERP size, such that more time is spent focused on earlier results when SERP size decreases.",
keywords = "search behaviour, user studies, search result page, search interface",
author = "Diane Kelly and Leif Azzopardi",
year = "2015",
month = "8",
day = "9",
doi = "10.1145/2766462.2767732",
language = "English",
isbn = "978-1-4503-3621-5",
pages = "183--192",
booktitle = "SIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval",

}

Kelly, D & Azzopardi, L 2015, How many results per page? a study of SERP size, search behavior and user experience. in SIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval . New York, NY, USA, pp. 183-192. https://doi.org/10.1145/2766462.2767732

How many results per page? a study of SERP size, search behavior and user experience. / Kelly, Diane; Azzopardi, Leif.

SIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval . New York, NY, USA, 2015. p. 183-192.

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

TY - GEN

T1 - How many results per page?

T2 - a study of SERP size, search behavior and user experience

AU - Kelly, Diane

AU - Azzopardi, Leif

PY - 2015/8/9

Y1 - 2015/8/9

N2 - The provision of "ten blue links" has emerged as the standard for the design of search engine result pages (SERPs). While numerous aspects of SERPs have been examined, little attention has been paid to the number of results displayed per page. This paper investigates the relationships among the number of results shown on a SERP, search behavior and user experience. We performed a laboratory experiment with 36 subjects, who were randomly assigned to use one of three search interfaces that varied according to the number of results per SERP (three, six or ten). We found subjects' click distributions differed significantly depending on SERP size. We also found those who interacted with three results per page viewed significantly more SERPs per query; interestingly, the number of SERPs they viewed per query corresponded to about 10 search results. Subjects who interacted with ten results per page viewed and saved significantly more documents. They also reported the greatest difficulty finding relevant documents, rated their skills the lowest and reported greater workload, even though these differences were not significant. This work shows that behavior changes with SERP size, such that more time is spent focused on earlier results when SERP size decreases.

AB - The provision of "ten blue links" has emerged as the standard for the design of search engine result pages (SERPs). While numerous aspects of SERPs have been examined, little attention has been paid to the number of results displayed per page. This paper investigates the relationships among the number of results shown on a SERP, search behavior and user experience. We performed a laboratory experiment with 36 subjects, who were randomly assigned to use one of three search interfaces that varied according to the number of results per SERP (three, six or ten). We found subjects' click distributions differed significantly depending on SERP size. We also found those who interacted with three results per page viewed significantly more SERPs per query; interestingly, the number of SERPs they viewed per query corresponded to about 10 search results. Subjects who interacted with ten results per page viewed and saved significantly more documents. They also reported the greatest difficulty finding relevant documents, rated their skills the lowest and reported greater workload, even though these differences were not significant. This work shows that behavior changes with SERP size, such that more time is spent focused on earlier results when SERP size decreases.

KW - search behaviour

KW - user studies

KW - search result page

KW - search interface

U2 - 10.1145/2766462.2767732

DO - 10.1145/2766462.2767732

M3 - Conference contribution book

SN - 978-1-4503-3621-5

SP - 183

EP - 192

BT - SIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval

CY - New York, NY, USA

ER -

Kelly D, Azzopardi L. How many results per page? a study of SERP size, search behavior and user experience. In SIGIR '15 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval . New York, NY, USA. 2015. p. 183-192 https://doi.org/10.1145/2766462.2767732