:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
Home Page:https://spiderclub.github.io/haipproxy/
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
grayguest opened this issue 3 years ago · comments
rule.py
validator scheduler will fetch tasks from resource queue and store into task queue
https://github.com/SpiderClub/haipproxy/blob/master/docs/%E9%85%8D%E7%BD%AE%E6%96%87%E4%BB%B6%E5%8F%82%E6%95%B0%E5%92%8C%E6%84%8F%E4%B9%89.md
校验器将从task_queue中获取代理IP,校验后存入resource,具体流程见 架构篇
哪个写反了?应该是temp -> validated吧