Twitter is not working
EnderRobber101 opened this issue · comments
Describe the bug
I get this error:
File "/home/runner/scrape/.pythonlibs/lib/python3.10/site-packages/snscrape/modules/twitter.py", line 886, in _get_api_data
r = self._get(endpoint, params = params, headers = self._apiHeaders, responseOkCallback = functools.partial(self._check_api_response, apiType = apiType, instructionsPath = instructionsPath))
File "/home/runner/scrape/.pythonlibs/lib/python3.10/site-packages/snscrape/base.py", line 275, in _get
return self._request('GET', *args, **kwargs)
File "/home/runner/scrape/.pythonlibs/lib/python3.10/site-packages/snscrape/base.py", line 271, in _request
raise ScraperException(msg)
snscrape.base.ScraperException: 4 requests to https://twitter.com/i/api/graphql/7jT5GT59P8IFjgxwqnEdQw/SearchTimeline?variables=%7B%22rawQuery%22%3A%22%23%23python%22%2C%22count%22%3A20%2C%22product%22%3A%22Latest%22%2C%22withDownvotePerspective%22%3Afalse%2C%22withReactionsMetadata%22%3Afalse%2C%22withReactionsPerspective%22%3Afalse%7D&features=%7B%22rweb_lists_timeline_redesign_enabled%22%3Afalse%2C%22blue_business_profile_image_shape_enabled%22%3Afalse%2C%22responsive_web_graphql_exclude_directive_enabled%22%3Atrue%2C%22verified_phone_label_enabled%22%3Afalse%2C%22creator_subscriptions_tweet_preview_api_enabled%22%3Afalse%2C%22responsive_web_graphql_timeline_navigation_enabled%22%3Atrue%2C%22responsive_web_graphql_skip_user_profile_image_extensions_enabled%22%3Afalse%2C%22tweetypie_unmention_optimization_enabled%22%3Atrue%2C%22vibe_api_enabled%22%3Atrue%2C%22responsive_web_edit_tweet_api_enabled%22%3Atrue%2C%22graphql_is_translatable_rweb_tweet_is_translatable_enabled%22%3Atrue%2C%22view_counts_everywhere_api_enabled%22%3Atrue%2C%22longform_notetweets_consumption_enabled%22%3Atrue%2C%22tweet_awards_web_tipping_enabled%22%3Afalse%2C%22freedom_of_speech_not_reach_fetch_enabled%22%3Afalse%2C%22standardized_nudges_misinfo%22%3Atrue%2C%22tweet_with_visibility_results_prefer_gql_limited_actions_policy_enabled%22%3Afalse%2C%22interactive_text_enabled%22%3Atrue%2C%22responsive_web_text_conversations_enabled%22%3Afalse%2C%22longform_notetweets_rich_text_read_enabled%22%3Afalse%2C%22longform_notetweets_inline_media_enabled%22%3Afalse%2C%22responsive_web_enhance_cards_enabled%22%3Afalse%2C%22responsive_web_twitter_blue_verified_badge_is_enabled%22%3Atrue%7D failed, giving up.
How to reproduce
import pandas as pd
from tqdm.notebook import tqdm
import snscrape.modules.twitter as sntwitter
scraper = sntwitter.TwitterHashtagScraper("#python")
for tweet in scraper.get_items():
break
tweet
followed this tutorial:https://www.youtube.com/watch?v=PUMMCLrVn8A
on replit: https://replit.com/@Ryan-MJMJ/scrape#main.py
Expected behaviour
To give me something
Screenshots and recordings
No response
Operating system
mac/replit
Python version: output of python3 --version
3.10.11
snscrape version: output of snscrape --version
0.7.0.20230622
Scraper
TwitterHashtagScraper
How are you using snscrape?
Module (import snscrape.modules.something in Python code)
Backtrace
No response
Log output
No response
Dump of locals
No response
Additional context
No response
