fgregg / ilcampaigncash

Load Illinois political contribute and spending data efficiently

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Illinois Campaign Cash loader

Load Illinois campaign fundraising data from the Illinois State Board of Elections.

Download the sqlite database.

Requirements

  • GNU Make
  • Python 3 (tested on 3.6 and 3.7)

Install

Install using the requirements.txt file:

pip install -r requirements.txt

Load all

Download, process, and load.

make all

Paralellization

This incantation should do the trick. It parallelizes downloading and data loading across 4 cores, while running database creation and view creation serially.

make -j4 all

About

Load Illinois political contribute and spending data efficiently

License:MIT License


Languages

Language:Makefile 56.2%Language:Python 43.8%