asad70 / reddit-sentiment-analysis

This program goes thru reddit, finds the most mentioned tickers and uses Vader SentimentIntensityAnalyzer to calculate the ticker compound value.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

prawcore.exceptions.TooLarge: received 413 HTTP response

dankstarr opened this issue · comments

I have been trying to grind at this error for the past week now. I have tried using the same parameters as in the example and it still gives the same error.
I also tried using https://pypi.org/project/pmaw/ for multi-threading it, but got the same error.

line 75, in
submission.comments.replace_more(limit=limit)
prawcore.exceptions.TooLarge: received 413 HTTP response

commented

Hey, it happens when the program is going thru posts with large number of comments >50k comments.
Here's a link to the error for more info: praw-dev/praw#1401
But adding the code into try/except block should does the work. I have added try/except to original code.

Hey, really appreciate the prompt reply. I had tried adding another try/except continue clause but it was skipping through the rest of the posts. Your new commit fixed it.
I am trying to get this code deployed to a heroku web server through flask. Is that okay with you?

commented

Yes, you are free to use this code however you want.

If you are willing to make it public i would love to see the finished version of it.

Hi, Im having the same problem with +50k comments, is there a solution yet? Cant find it anywhere

commented

Hi, Im having the same problem with +50k comments, is there a solution yet? Cant find it anywhere

@AnniaLevko Hey, it seems like a limitation on reddit side.

Here's more info and workaround: https://www.reddit.com/r/redditdev/comments/7si641/praw_530_toolarge_received_413_http_response_when/