Use scrapy with mongodb to store the request queues (FIFO or LIFO)
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
