erlichsefi / supermarket-scraping

Supermarket basic scraping

The library supports scraping from Shufersal, CoOp, Rami Levi, Osher Ad, Zol Vebegadol, Tiv Taam, Freshmarket, Mahsanei Hashook, Victory, Maayan2000, Yohananof, Stop Market, Keshet Taamim, Hazi Hinam, Dor Alon supermarkets, Shefa Birkat Hashem, Shuk Hayir, King Store and Super Bareket.

Installation

clone:

git clone https://github.com/korenLazar/supermarket-scraping.git
cd supermarket-scraping
virtualenv venv
venv\bin\activate
pip install -r requirements.txt

Dependencies

1. python (3.7+)
2. virtualenv

Usage

First, to find your Shufersal store's ID, you can run the following command (assuming you live in Jerusalem):

python main.py --find_store ירושלים --chain Shufersal

In case you want a different supermarket chain, just change 'Shufersal' to a different name (the options will be printed in case of misspelling).

The output of the last command - the different Shufersal stores in Jerusalem with their IDs - should be printed.

Now, that we have the store's ID, we can get the store's relevant promotions sorted by their start date, last update and length.

python main.py --promos 5 --chain Shufersal

• We assumed that the store's ID is 5. Now, you can find the promos in both "results\Shufersal_promos_5.csv" and "results\Shufersal_promos_5.log".

For other documentation and commands, you can run

python main.py --h

Any file that was downloaded in the process will be located in the "raw_files" directory.

Good luck!