Error "Gave up Trying" :return 429 status

[igo312]

There is a same problem here #80
Here's my error information

Gave up retrying (failed 3 times): 429 Unknown Status

I know it's about sending too much request and the Twiiter website reject the request then scrapy stop crawling
So what I do now is using time.sleep() in start_request and parse_page of TweetCrawler.py
It seems work but apparently it will slow down the crawling speed.
Is there a better way to fix it?

@carlafdzzz my solution may help you.