Abstract
In this paper we present some new methods of ranking information retrieval systems without relevance judgement. The common ground of these methods is using a measure we called reference count . An extensive experimentation was conducted to evaluate the effectiveness of the proposed methods using various different standards Information Retrieval evaluation measures for the ranking, like average precision, R-precision, and precision and different document levels. We also compared the effectiveness of the proposed methods with the method proposed by Soboroff et al. The experimental results showed that the proposed methods are effective, and in many cases are more effective than Soboroff at al.'s method.
Original language | English |
---|---|
Pages | 811-816 |
Number of pages | 5 |
Publication status | Published - Mar 2003 |
Event | Proceedings of the 2003 ACM Symposium on Applied Computing - Melbourne, Florida, USA Duration: 9 Mar 2003 → 12 Mar 2003 |
Conference
Conference | Proceedings of the 2003 ACM Symposium on Applied Computing |
---|---|
City | Melbourne, Florida, USA |
Period | 9/03/03 → 12/03/03 |
Keywords
- information retrieval
- ranking
- relevance judgement
- performance evaluation