k-nut / unisport-scrapers

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

unisport-scrapers

Scrapers for all sports classes offered by universities in Berlin.

Installation

Create a new virtualen environment with virtualenv unisport-scrapers -p /usr/local/bin/python3, activate it via source unisport-scrapers/bin/activate and install the requirements with pip install -r requirements.txt

Running

You can run an individual scraper via scrapy crawl hu -o hu.json or run a script that runs all scrapers and merges their results in a file called alle.json by running run_all.sh

About


Languages

Language:Python 98.1%Language:Shell 1.9%