Relevance is a fundamental concept in the Information Retrieval field. As part of the relevance judgment process, users apply several relevance criteria to judge retrieved objects. Relevance judgments and the criteria used to make these judgments are known to be dynamic. Many research attempted to explore relevance criteria users apply when making relevance judgment decisions and examine the dynamic selection of relevance criteria at different stages of the search process. Previous relevance criteria studies focussed on work contexts and the information judged was mainly in text format; with the result that little is known about relevance criteria and its dynamic aspects when applied in leisure contexts, specifically for video content. The purpose of this research is to understand how typical users of YouTube judge the relevance of videos in leisure contexts; what are the reasons users give when judging video material as relevant or not relevant? Furthermore, the research investigates the dynamic aspects of relevance criteria by examining the differences in relevance criteria at the stages of selecting and viewing videos for leisure. This research encompasses two main studies. In the first study, a naturalistic diary was performed in which 30 participants completed diaries providing details on their video relevance criteria. In the second study, 24 participants were asked to search YouTube for leisure purposes followed by a semi-structured interview to elicit relevance criteria usage at different stages of the search process.In total, 28 relevance criteria were identified through the analyses of the diaries’ contents and they were grouped into eight categories. The findings revealed that criteria related to the content of the video are the most dominant group of criteria with Topicality being the most dominant criterion. There is a considerable overlap between leisure relevance criteria and previous relevance criteria studies in academic or work-related contexts, but the importance of these criteria varies among different contexts. New criteria, e.g. Habit, emerged from the data which tend to be more related to leisure contexts. The findings of the dynamic use of relevance criteria study showed significant differences between the selecting and viewing stages in term of the use of relevance criteria with, some criteria being preferred in the selection stage while others are more important at the viewing stage of video interaction. The findings also demonstrated that applying different methods (naturalistic diary study and recorded sessions with interviews) revealed similar and consistent findings.This research attempted to enrich the current literature by investigating users’ video relevance criteria in leisure contexts. Understanding the changes in relevance criteria during the search process provides new insights into the dynamic aspects of relevance judgment and aids the design of information retrieval systems.
|Date of Award||26 Sep 2018|
- University Of Strathclyde
|Supervisor||Ian Ruthven (Supervisor) & Dmitri Roussinov (Supervisor)|