Methods for ranking information retrieval systems without relevance judgements

S. Wu, F. Crestani

Research output: Contribution to conferencePaperpeer-review

64 Citations (Scopus)

Abstract

In this paper we present some new methods of ranking information retrieval systems without relevance judgement. The common ground of these methods is using a measure we called reference count . An extensive experimentation was conducted to evaluate the effectiveness of the proposed methods using various different standards Information Retrieval evaluation measures for the ranking, like average precision, R-precision, and precision and different document levels. We also compared the effectiveness of the proposed methods with the method proposed by Soboroff et al. The experimental results showed that the proposed methods are effective, and in many cases are more effective than Soboroff at al.'s method.
Original languageEnglish
Pages811-816
Number of pages5
Publication statusPublished - Mar 2003
EventProceedings of the 2003 ACM Symposium on Applied Computing - Melbourne, Florida, USA
Duration: 9 Mar 200312 Mar 2003

Conference

ConferenceProceedings of the 2003 ACM Symposium on Applied Computing
CityMelbourne, Florida, USA
Period9/03/0312/03/03

Keywords

  • information retrieval
  • ranking
  • relevance judgement
  • performance evaluation

Fingerprint

Dive into the research topics of 'Methods for ranking information retrieval systems without relevance judgements'. Together they form a unique fingerprint.

Cite this