A retrieval evaluation methodology for incomplete relevance assessments

Research output: Chapter in Book/Report/Conference proceedingChapter

2 Citations (Scopus)
37 Downloads (Pure)

Abstract

In this paper we a propose an extended methodology for laboratory based Information Retrieval evaluation under in complete relevance assessments. This new protocol aims to identify potential uncertainty during system comparison that may result from incompleteness. We demonstrate how this methodology can lead towards a finer grained analysis of systems. This is advantageous, because the detection of uncertainty during the evaluation process can guide and direct researchers when evaluating new systems over existing and future test collections.
Original languageEnglish
Title of host publicationAdvances in Information Retrieval: 29th European Conference on IR Research (ECIR 2007)
PublisherSpringer
Number of pages12
Volume4425
ISBN (Print)978-3-540-71494-1
Publication statusPublished - 2007

Publication series

NameLecture Notes in Computer Science
PublisherSpringer

Keywords

  • information retrieval
  • document retrieval
  • relevance ranking
  • searching

Fingerprint Dive into the research topics of 'A retrieval evaluation methodology for incomplete relevance assessments'. Together they form a unique fingerprint.

  • Cite this

    Baillie, M., Azzopardi, L., & Ruthven, I. (2007). A retrieval evaluation methodology for incomplete relevance assessments. In Advances in Information Retrieval: 29th European Conference on IR Research (ECIR 2007) (Vol. 4425). (Lecture Notes in Computer Science). Springer.