lhy's repositories
crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Language:GoBSD-3-Clause000
crawlab-lite
Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Language:VueBSD-3-Clause000
Language:Java000
pyppeteer
Headless chrome/chromium automation library (unofficial port of puppeteer)
Language:PythonNOASSERTION000
Language:PythonBSD-2-Clause000
you-get
:arrow_double_down: Dumb downloader that scrapes the web
Language:PythonNOASSERTION000
ZhiHuUserRelation
知乎用户人际关系信息抓取,python3 + scrapy + mongodb
Language:Python000