Distributed and concurrent web crawler.
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
Distributed and concurrent implementation of a polite web crawler.
License:Apache License 2.0