earllee / datafall

A lightweight framework to aggregate data from a variety of different sources with intelligent text-based web scraping.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

datafall

Setup

  1. Install pdftotext and wkhtmltopdf.
  2. Install MongoDB.
  3. Run pip install -r requirements.txt.
  4. Use libraries or try test.py.

About

A lightweight framework to aggregate data from a variety of different sources with intelligent text-based web scraping.


Languages

Language:Python 100.0%