The Race Is On
TWO PHILOSOPHIES FOR INDEXING THE WWW
“ALIWEB was conceived sometime in the summer of 1993. It was clear the Web was enjoying a widespread popularity, and was growing at an enormous rate. It became evident that finding things in a large Web was becoming a problem that existing catalogues maintained by individuals could not address.” It provided a searchable database without spiders.
WWW Wanderer: “In September 1993 my Web server mailed me a report indicating someone had been retrieving an unusually large number of documents from my Web server. Further investigation indicated that at three points in time the same sequence of documents was retrieved at an enormous rate, in the order of 1 document per second. The sequence of documents showed that they were all interlinked; A Web wanderer had been at work.”