SpiderClub

SpiderClub

Geek Repo

A group interested in web crawler.

Location:China

Github PK Tool:Github PK Tool

SpiderClub's repositories

haipproxy

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

Language:PythonLicense:MITStargazers:5434Issues:206Issues:98

weibospider

:zap: A distributed crawler for weibo, building with celery and requests.

Language:PythonLicense:MITStargazers:4800Issues:290Issues:158

smart_login

各大网站登陆方式,有的是通过selenium登录,有的是通过抓包直接模拟登录(精力原因,目前不再继续维护)

Language:PythonLicense:MITStargazers:1010Issues:64Issues:25