A scalable and fault-tolerant architecture for distributed web-resource discovery

A. Fongen, F. Eliassen, I. Ferguson, S. Stobart, J. Tait

Research output: Chapter in Book/Report/Conference proceedingChapter

38 Downloads (Pure)

Abstract

Most Internet search engines are built on a centralised design, and will therefore not cope with the expected future growth in information and query volume. A distributed approach to Internet resource discovery seems necessary. Many distributed designs have been proposed, but their scaleability is largely unknown. We propose a distributed design based on the use of classified metadata, which can be proven to be extremely scaleable, and has interesting fault-tolerant properties. We will show the principles of this design, called the Content- Sensitive Infrastructure (CSI), and demonstrate its properties through formal analysis and simulation.
Original languageEnglish
Title of host publicationProceedings of the 14th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2002)
Place of PublicationCambridge, USA
Number of pages7
Publication statusPublished - 2002

Keywords

  • search engines
  • resource discovery
  • programming
  • distributed systems
  • networking
  • computer applications
  • large scale distribution
  • distributed resource discovery
  • peer-to-peer networking

Fingerprint

Dive into the research topics of 'A scalable and fault-tolerant architecture for distributed web-resource discovery'. Together they form a unique fingerprint.

Cite this