leopardslab / CrawlerX

CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

leopardslab/CrawlerX Stargazers