Abstract
Most Internet search engines are built on a centralised
design, and will therefore not cope with the expected
future growth in information and query volume.
A distributed approach to Internet resource discovery
seems necessary. Many distributed designs have been proposed, but their scaleability is largely unknown.
We propose a distributed design based on the use of
classified metadata, which can be proven to be extremely
scaleable, and has interesting fault-tolerant properties. We
will show the principles of this design, called the Content-
Sensitive Infrastructure (CSI), and demonstrate its properties through formal analysis and simulation.
Original language | English |
---|---|
Title of host publication | Proceedings of the 14th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2002) |
Place of Publication | Cambridge, USA |
Number of pages | 7 |
Publication status | Published - 2002 |
Keywords
- search engines
- resource discovery
- programming
- distributed systems
- networking
- computer applications
- large scale distribution
- distributed resource discovery
- peer-to-peer networking