suddi / fundscraper

Collection of web crawlers to scrape fund data using Scrapy

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

fundscraper

CircleCI Codacy Badge license

Scrapy web crawlers to collect fund data

Installation

If you have virtualenvwrapper, set up a virtual environment with the following command:

mkvirtualenv fundscraper

Install dependencies:

pip install -r requirements.txt

Install dev dependencies:

python install -r test_requirements.txt

Usage

To crawl utilizing a spider:

scrapy crawl aia.com.hk

To calculate returns from historic data:

python setup.py compute_returns

To compute most performant funds:

python setup.py compute_performing_funds

About

Collection of web crawlers to scrape fund data using Scrapy

License:Apache License 2.0


Languages

Language:Python 100.0%