bda-research / node-crawler

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

Home Page:http://node-crawler.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

No retry when status code 404

asahimx-d opened this issue · comments

Can i have retry when status code is 404/502?
Retry only trigger when timeout.

Nope, you see that, if a page status code is 404, why do you want to retry any more?