A webcrawler for cryptos using Scrapy.
This package get crypto currencies data from "https://www.livecoinwatch.com".
Input:
Output:
- Python
- Scrapy (web scraping python framework)
- Python 3.x
- Google Chrome
- chromedriver
-
Clone this repository and move to root folder.
-
Download chromedriver on "https://chromedriver.chromium.org/downloads" accordingly to your local Chrome version.
-
Unzip chromedriver to project's root.
Create a python environment:
python3 -m venv venv
Activate the virtual environment and update pip:
sourve venv/bin/activate
pip install -r requirements.txt
On root directory run:
scrapy crawl coin_selenium -o results.csv
Check your "results.csv".