Analyzing the influence of bigrams on retrieval bias and effectiveness

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

Abstract

Prior work on using retrievability measures in the evaluation of information retrieval (IR) systems has laid out the foundations for investigating the relationship between retrieval effectiveness and retrieval bias. While various factors influencing bias have been examined, there has been no work examining the impact of using bigram within the index on retrieval bias. Intuitively, how the documents are represented, and what terms they contain, will influence whether they are retrievable or not. In this paper, we investigate how the bias of a system changes depending on how the documents are represented using unigrams, bigrams or both. Our analysis of three different retrieval models on three TREC collections, shows that using a bigram only representation results in the lowest bias compared to unigram only representation, but at the expense of retrieval effectiveness. However, when both representations are combined it results in reducing the overall bias, as well as increasing effectiveness. These findings suggest that when configuring and indexing the collection, that the bag-of-words approach (unigrams), should be augmented with bigrams to create better and fairer retrieval systems.
Original languageEnglish
Title of host publicationThe ICTIR '20 - The 2020 ACM SIGIR International Conference on the Theory of Information Retrieval
Place of PublicationNew York, NY.
Pages157–160
Number of pages4
DOIs
Publication statusPublished - 1 Sep 2020
EventACM SIGIR International Conference on the Theory of Information Retrieval 2020 - Stavanger, Norway, Stavanger, Norway
Duration: 14 Sep 202018 Sep 2020
Conference number: 6
https://ictir2020.org

Conference

ConferenceACM SIGIR International Conference on the Theory of Information Retrieval 2020
Abbreviated titleICTIR 2020
CountryNorway
CityStavanger
Period14/09/2018/09/20
Internet address

Keywords

  • information retrieval
  • bigrams
  • retrieval systems
  • bag-of-words
  • unigrams

Cite this

AlQatan, A., Azzopardi, L., & Moshfeghi, Y. (2020). Analyzing the influence of bigrams on retrieval bias and effectiveness. In The ICTIR '20 - The 2020 ACM SIGIR International Conference on the Theory of Information Retrieval (pp. 157–160). https://doi.org/10.1145/3409256.3409831