Giters

godkingjay / selenium-twitter-scraper

This is a Twitter Scraper which uses Selenium for scraping tweets. It is capable of scraping tweets from home, user profile, hashtag, query or search, and advanced searches.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Scrapping stuck if you don't provide tweet count

ahmethudaiaydin opened this issue · comments

commented

When I try to scrap with following line
python scraper --user=@username--password=password --query="(queryparam) until:2024-05-19 since:2024-04-19"
It is stucking as you can see in following image:
image

It cannot continue the process.
It is also same if I try to give a higher number like 10000. It grabs some of data but then stuck again for "waiting to access older tweets"

I think problem occurs on "waiting to access older tweets" part. It never get a response for that part again.