YACY

1.2 GPL (GNU General Public License)    
3.3/5 30

  1,382 downloads

YACY is a distributed Web crawler and also a caching HTTP/HTTPS proxy.

description

download

specs

changelog

YACY is a distributed Web crawler and also a caching HTTP/HTTPS proxy. Pages that pass through the proxy are indexed and can be searched using a built-in HTTP server.

YACY peers connect each other and form a P2P-based index exchange network based on distributed hash tables. Explicit web crawls can be done locally or collaboratively, forming a global search and distributed indexing engine for the Web.

YACY also provides URL filtering with blacklist sharing among other proxy peers, individual Web and servlet page hosting, a file sharing zone, and a database engine.
read more   
Last updated on November 9th, 2012
YACYYACY

0 User reviews so far.

SUBMIT

#web crawler #HTTP proxy #HTTPS proxy #YACY #web #crawler #HTTP