ignaciop000 / precios-claros

Precios Claros (http://preciosclaros.gob.ar) scraper / data downloader

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Precios Claros data downloader

A set of Python scripts to download http://preciosclaros.gob.ar Argentina's markets and supermarkets prices data to a SQLite database.

Important

This code is working today (February 26, 2018) but probably almost any further changes to the API will broke it.

If you decide to adapt to make it work to any new API version make a Pull Request with your adaptations, will be greatly appreciated.

If you have any kind of doubts or suggestions don't hesitate to create an issue.

Installation

  1. Clone this repo and get into
git clone https://github.com/martjanz/precios-claros && cd precios-claros
  1. (optional) Create a Python virtual environment, then activate it
virtualenv venv && source venv/bin/activate
  1. Install Python dependencies
pip install -r requirements.txt

Run

./scrap.sh

The result will be a SQLite database called data.sqlite where all data will be stored.

About

Precios Claros (http://preciosclaros.gob.ar) scraper / data downloader


Languages

Language:Python 95.1%Language:Shell 4.9%