It keeps searching forever.
opened this issue · comments
It just searches everywhere... I sometimes think that it searches every single website.
Nothing is wrong, it just does not stop, I can see the websites it is searching in, but after 1 - 1.30 hours later it keeps searching unrelated website and does not stop searching.
Are my keywords wrong? What can I do?
I will join the question
I run into tha same issue. I replaced the following row in email_crawler.py file (line 95):
request = urllib2.urlopen(req)with this:
request = urllib2.urlopen(req, timeout=10)