Indexing without spam

Guido Zuccon, Teerapong Leelanupab, Anthony Nguyen, Leif Azzopardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

4 Citations (Scopus)
7 Downloads (Pure)

Abstract

The presence of spam in a document ranking is a major issue for Web search engines. Common approaches that cope with spam remove from the document rankings those pages that are likely to contain spam. These approaches are implemented as post-retrieval processes, that filter out spam pages only after documents have been retrieved with respect to a user's query. In this paper we propose removing spam pages at indexing time, therefore obtaining a pruned index that is virtually "spam-free". We investigate the benefits of this approach from three points of view: indexing time, index size, and retrieval performance. Not surprisingly, we found that the strategy decreases both the time required by the indexing process and the space required for storing the index. Surprisingly instead, we found that by considering a spam-pruned version of a collection's index, no difference in retrieval performance is found when compared to that obtained by traditional post-retrieval spam filtering approaches.

Original languageEnglish
Title of host publicationADCS 2011 - Proceedings of the Sixteenth Australasian Document Computing Symposium
Place of PublicationMelbourne, Vic.
Pages6-13
Number of pages8
Publication statusPublished - 1 Dec 2011
Event16th Australasian Document Computing Symposium, ADCS 2011 - Canberra, ACT, Australia
Duration: 2 Dec 20112 Dec 2011

Conference

Conference16th Australasian Document Computing Symposium, ADCS 2011
CountryAustralia
CityCanberra, ACT
Period2/12/112/12/11

Keywords

  • efficiency
  • index pruning
  • information retrieval
  • spam
  • web search
  • indexing (of information)
  • search engines
  • document ranking

Fingerprint Dive into the research topics of 'Indexing without spam'. Together they form a unique fingerprint.

  • Cite this

    Zuccon, G., Leelanupab, T., Nguyen, A., & Azzopardi, L. (2011). Indexing without spam. In ADCS 2011 - Proceedings of the Sixteenth Australasian Document Computing Symposium (pp. 6-13).