Sciencenet

Infobox Software
name = Sciencenet YaCy


caption =
developer = Michael Christen
latest_release_version = 0.61
latest_release_date = October 2, 2008
operating_system = Platform independent
genre = Search engine
programming_language = Java
license = GNU General Public License
website = http://sciencenet.fzk.de

"Sciencenet" is an experimental search engine at KIT (Karlsruhe Institute of Technology - [http://liebel.fzk.de Liebel-Lab] ) for scientific knowledge. The Sciencenet software (YaCy) is based on p2p technology developed by Michael Christen in collaboration with [http://liebel-lab.fzk.de Liebel-lab] at Karlsruhe Institute of Technology.

Background

Scientific knowledge is spread across many database, research institutes, educational websites and literature repositories. Today's search engines success is often based on popularity ranking. Popularity ranking is a powerful method for general search strategies, but less efficient for scientific knowledge. The Sciencenet search engine is especially for scientific websites and scientific content. Its index is a collection of educational (e.g. of ".edu" / ".ac.uk" /".ac.au") and research dedicated sites (e.g. the German Helmholtz society, Max Planck institutes or Swiss and Austrian universities). This is the major difference to the global YaCy search engine ("Freeworld"), which serves as a global search engine.

Sciencenet architecture

Sciencenet is a network of Linux PCs running "YaCy" software. The "Sciencenet core cluster" is located at the Institute of Toxicology and Genetics (Liebel-Lab), KIT Karlsruhe (Karlsruhe Institute of Technology).

Sciencenet-YaCy software has been designed and tested to run in a network with at least 2000 CPUs, with up to 10 Mio webpages per single CPU, allowing to search large and/or distributed information repositories.

Mission

Any university / research institute is encouraged to use the software and contribute to the scientific network. The software automatically connects to the "core cluster" and contributes its search engine to the distributed sciencenet network. A high speed internet broadband connection (> 2 Mbit/s) and dedicated PCs are required. Ideally every research institute runs the free YaCy-Sciencenet software on 1-2 local PCs and provides its webpages to the network. As a side effect, wasted bandwidth from external search engines is reduced to a minimum. The sciencenet ideally provides a free, open scientific search engine index to the community.

Sciencenet current status

* Currently (Sept, 2008) 47 low cost Linux-PCs running Java and YaCy software share ~150.000.000 documents in a distributed peer2peer network.

See also

* YaCy, a distributed free p2p search engine

External links

* The [http://sciencenet.fzk.de Sciencenet search portal]

* See the current [http://141.52.175.10:8080/Network.html? Sciencenet network] overview.
* See the [http://141.52.175.10:8080/Network.html?page=1 participating peers] with detailed index information.

* Full [http://liebel.fzk.de/collaborations/sciencenet-search-engine-based-on-yacy-p2p-technology sciencenet article] at liebel-lab KIT website (plus software download)
* [http://liebel-lab.fzk.de Liebel-Lab] @ KIT
* [http://yacy.net yacy.net]