infinite-twitter-crawler
Description
This python crawler script is meant to download tweet message from a twitter infinite scrolling page. The message and its time stamp will be saved as a csv file.
Dependencies
- Python 3.7
- BeautifulSoup 4.6.3
- Selenium 3.141.0
Execution
- Download this project.
- Run the script as below.
python crawler.py
- Set file name, or default will be used. Set path to chrome driver or default will be used.