Commenters seem to be broken

Question

Commenters seem to be broken

razki opened this issue 5 years ago · comments

Afternoon,

When scraping the profiles it seems that there is an issue when trying to get the commenters of a particular post:

ERROR [2019-07-31 15:22:58] ERROR something went wrong getting user_commented
ERROR [2019-07-31 15:22:58] ERROR something went wrong getting comment

Probably a duplicate of #152 But creating another Issue to surface it

Daniel Mayusa Dewa · Answer 1 · Thu Aug 15 2019 04:09:30 GMT+0800 (China Standard Time)

hey, I fixed it actually but I'm still trying to fix the others, so go to utils/extractor_posts.py. change all the user_commented[3] from this line to user_commented[1]

user_commented = comm.find_element_by_tag_name('a').get_attribute("href").split('/') user_commented_list.append(user_commented[3])

lamoo · Answer 2 · Fri Aug 23 2019 20:50:23 GMT+0800 (China Standard Time)

hey, I fixed it actually but I'm still trying to fix the others, so go to utils/extractor_posts.py. change all the user_commented[3] from this line to user_commented[1]

user_commented = comm.find_element_by_tag_name('a').get_attribute("href").split('/') user_commented_list.append(user_commented[3])

Hi, Thank's for this solution, but same comments still broken.
Did you have solution?

Daniel Mayusa Dewa · Answer 3 · Tue Sep 03 2019 02:21:14 GMT+0800 (China Standard Time)

hey, I fixed it actually but I'm still trying to fix the others, so go to utils/extractor_posts.py. change all the user_commented[3] from this line to user_commented[1]
user_commented = comm.find_element_by_tag_name('a').get_attribute("href").split('/') user_commented_list.append(user_commented[3])

Hi, Thank's for this solution, but same comments still broken.
Did you have solution?

I actually fixed it by changing it to 1, I currently do not have any problem. Just so we're clear, did you login to your account before scraping the comments ? and is the account you're scraping public ?