The repo contains the crawler to get the xls/x data from the Investment firms, in use for the Open Pension project. Open Pension is a "Hasadna" project, that aimed to revealing the secrets behind the Israeli pension market.
- Make sure you have Python 3.x and pip installed.
pip install -r requirements.txt.
- To run
amitimcrawlerscrapy crawl amitim - To run
yl-investcrawlerscrapy crawl yl-invest - To run
as-investcrawlerscrapy crawl as-invest - To run
clalbitcrawlerscrapy crawl clalbit - To run
metiav dashcrawlerscrapy crawl meitav_dash(not working) - To run
fnxcrawlerscrapy crawl fnx - To run
harelcrawlerscrapy crawl harel(not working now) - To run
menoracrawlerscrapy crawl menora(not working now) - To run
migdalcrawlerscrapy crawl migdal - To run
psagotcrawlerscrapy crawl psagot - To run
xnescrawlerscrapy crawl xnes(partly)
Not yet.
Just fork and do a pull request (;