danrneal / hot-100-crawler

A script that crawls Wikipedia Hot 100 lists and get all number one hits and their album info and release dates.

Hot 100 Crawler

A script that crawls Wikipedia Hot 100 lists and get all number one hits and their album info and release dates.

Set-up

Set-up a virtual environment and activate it:

python3 -m venv env
source env/bin/activate

You should see (env) before your command prompt now. (You can type deactivate to exit the virtual environment any time.)

Install the requirements:

pip install -U pip
pip install -r requirements.txt

Usage

Make sure you are in the virtual environment (you should see (env) before your command prompt). If not source /env/bin/activate to enter it.

Usage: crawler.py

License

Route Planner is licensed under the MIT license.