Query quality: user ratings and system predictions

Claudia Hauff, Franciska de Jong, Diane Kelly, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

5 Citations (Scopus)


Numerous studies have examined the ability of query performance prediction methods to estimate a query's quality for system effectiveness measures (such as average precision). However, little work has explored the relationship between these methods and user ratings of query quality. In this poster, we report the findings from an empirical study conducted on the TREC ClueWeb09 corpus, where we compared and contrasted user ratings of query quality against a range of query performance prediction methods. Given a set of queries, it is shown that user ratings of query quality correlate to both system effectiveness measures and a number of pre-retrieval predictors.
Original languageEnglish
Title of host publicationSIGIR '10 Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval
Place of PublicationNew York, NY, USA
Number of pages2
Publication statusPublished - 19 Jul 2010
Externally publishedYes


  • query performance prediction
  • information retrieval


Dive into the research topics of 'Query quality: user ratings and system predictions'. Together they form a unique fingerprint.

Cite this