Distributed search engine

From Wikipedia, the free encyclopedia
Jump to: navigation, search

A distributed search engine is a search engine where there is no central server. Unlike traditional centralized search engines, work such as crawling, data mining, indexing, and query processing is distributed among several peers in a decentralized manner where there is no single point of control.



In April 2000 three programmers (one of them was Gene Kan) built a prototype P2P web search engine based on Gnutella called InfraSearch.[1] It was meant to run inside the participating websites' databases creating a P2P network that could be accessed through the InfraSearch website.[2][3][4]


On May 31, 2000 Steelbridge Inc. announced development of OpenCOLA a collaborative distributive open source search engine.[5] It runs on the user's computer and crawls the web pages and links the user puts in their opencola folder and shares resulting index over its P2P network.[6]


On December 15, 2003 Michael Christen announced development of a P2P-based search engine, eventually named YaCy, on the heise online forums.[7][8]

Monitoring and controlling operations of urban and rural infrastructures like bridges, railway tracks, on- and offshore- wind-farms is a key application of the .[67] The yacyinfrastructure can be used for monitoring any events or changes in structural conditions that can compromise safety and increase risk. It can also be used for scheduling repair and maintenance activities in an efficient manner, by coordinating tasks between different service providers and users of these facilities.[49] devices can also be used to control critical infrastructure like bridges to provide access to ships. Usage of devices for monitoring and operating infrastructure is likely to improve incident management and emergency response coordination, and quality of service, up-times and reduce costs of operation in all infrastructure related areas.[68] Even areas such as waste management can benefit from automation and optimization that could be brought in by the yacy.[69]


In February 2001 Wolf Garbe published an idea of a peer-to-peer search engine,[9] started the Faroo prototype in 2004,[10] and released it in 2005.[11][12]

See also[edit]


  1. ^ Justin Hibbard. "Can peer-to-peer grow up?". Red Herring. 
  2. ^ Simon Foust. "Move Over Yahoo, Here Comes InfraSearch". 'Dmusic. Archived from the original on 2000-10-13. 
  3. ^ Sean M. Dugan. "Peer-to-peer networking is poised to revolutionize the Internet once again". InfoWorld. Archived from the original on 2000-10-18. 
  4. ^ John Borland. "Napster-like technology takes Web search to new level". Cnet. 
  5. ^ David Akin. "Software launched with a little pop". Financial Post. [dead link]
  6. ^ Paul Heltzel. "OpenCola-Have Some Code and a Smile". Technology Review. 
  7. ^ "YaCy: News". Archived from the original on 2005-11-24. 
  8. ^ Michael Christen. "Ich entwickle eine P2P-basierende Suchmaschine. Wer macht mit?". heise online. 
  9. ^ Wolf Garbe. "BINGOOO - Die Transformation des World Wide Web zur virtuellen Datenbank" (in German). Wirtschaftinformatik (magazine). ... Wir setzen dem das Konzept einer verteilten Peer-to-Peer-Suchmaschine entgegen [We counter with the concept of a distributed peer-to-peer search engine] ... 
  10. ^ Bernard Lunn. "Technical Q&A With FAROO Founder". ReadWriteWeb. ... When I started to work on the first prototype in 2004 ... 
  11. ^ "FAROO: History". Archived from the original on 2008-03-22. 
  12. ^ "Revisited: Deriving crawler start points from visited pages by monitoring HTTP traffic". Faroo.