Projects per year
Abstract
Relevance is a complex, but core, concept within the field of Information Retrieval. In order to allow system comparisons the many factors that influence relevance are often discarded to allow abstraction to a single score relating to relevance. This means that a great wealth of information is often discarded. In this paper we outline the creation of a video test collection with graded relevance assessments, to the best of our knowledge the first example of such a test collection for video retrieval. To directly address the shortcoming above we also gathered behavioural and perceptual data from assessors during the assessment process. All of this information along with judgements are available for download. Our intention is to allow other researchers to supplement the judgements to help create an adaptive test collection which contains supplementary information rather than a completely static collection with binary judgements.
Original language | English |
---|---|
Title of host publication | CHIIR'16 |
Subtitle of host publication | Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval |
Place of Publication | New York |
Pages | 309-312 |
Number of pages | 4 |
DOIs | |
Publication status | Published - 13 Mar 2016 |
Event | ACM SIGIR Conference on Human Information Interaction and Retrieval - North Carolina, Chapel Hill, United States Duration: 13 Mar 2016 → 17 Mar 2016 |
Conference
Conference | ACM SIGIR Conference on Human Information Interaction and Retrieval |
---|---|
Country/Territory | United States |
City | Chapel Hill |
Period | 13/03/16 → 17/03/16 |
Keywords
- video
- variable
- graded
- relevance
- information retrieval
- test collection
Fingerprint
Dive into the research topics of 'Video test collection with graded relevance assessments'. Together they form a unique fingerprint.Projects
- 1 Finished
-
Understanding the annotation process: annotation for Big Data
Halvey, M. (Principal Investigator)
AHRC (Arts and Humanities Research Council)
1/08/14 → 30/06/15
Project: Research
Datasets
-
Video Test Collection with Graded Relevance Assessments
Qiying, W. (Creator), Halvey, M. (Creator) & Villa, R. (Contributor), University of Strathclyde, 6 Jan 2016
DOI: 10.15129/7f16e19f-794a-4cd5-a9d7-caba4e2bcf2a, http://bufvc.ac.uk/newsonscreen/roundabout
Dataset