Get the best offers and promotions from different online stores in Chile so you can take advantage of the best discounts
The system is in charge of carrying out web scraping to the different online stores in search of the best offers and these are stored in a mongodb database for later use in other systems.
In addition, it allows you to inform about offers through a telegram channel.
It is required to have previously installed the following
nodejs >= 14.x
mongodb >= 5.x
postgresql
Install this project with npm
npm install
Clone the project
git clone https://github.com/luiscruzga/offersChile
Go to the project directory
cd offersChile
Install dependencies
npm install
Start the server
npm start
Once finished, you will be able to review the offers in the DB (by default it is hosted at mongodb://localhost/storePromotions)
Stores from which promotions are currently obtained
Store | Url | Time(minutes) |
---|---|---|
Abcdin | https://www.abcdin.cl | 1 |
Adidas | https://www.adidas.cl | 7 |
Best Store | https://www.beststore.cl | 2 |
CIntegral | https://cintegral.cl | 2 |
Dafiti | https://www.dafiti.cl | 1 |
Decathlon | https://www.decathlon.cl | 1 |
Easy | https://www.easy.cl | 11 |
El Container | https://www.elcontainer.cl | 1 |
Entel | https://miportal.entel.cl | 1 |
Falabella | https://www.falabella.com/falabella-cl | 74 |
Hites | https://www.hites.com | 27 |
Jumbo | https://www.jumbo.cl | 9 |
Knasta | https://knasta.cl | 2 |
La Barra | https://labarra.cl | 1 |
La Polar | https://www.lapolar.cl | 10 |
Lider | https://www.lider.cl/catalogo | 10 |
Lider-Supermercado | https://www.lider.cl/supermercado/ | 10 |
Movistar | https://catalogo.movistar.cl | 2 |
Olimpo Sports | https://olimposports.cl | 1 |
Paris | https://www.paris.cl | 88 |
Ripley | https://simple.ripley.cl | 3 |
Santa Isabel | https://www.santaisabel.cl | 7 |
Tricot | https://www.tricot.cl | 2 |
WOM | https://store.wom.cl | 1 |
Note: these times can be further reduced by modifying the default delay times in the configuration file, but keep in mind that cpu consumption can skyrocket if not controlled correctly given the parallelism that occurs
The products are stored in the DB as follows
{
store: 'Hites',
sku: '808253002',
name: 'Zapatilla Urbana Chunky Mujer Rolly Go',
description: 'Zapatilla Urbana Chunky Mujer Rolly Go',
brand: 'ROLLY GO',
url: 'https://www.hites.com/zapatilla-urbana-chunky-mujer-rolly-go-808253002.html',
images: ['https://www.hites.com/dw/image/v2/BDPN_PRD/on/demandware.static/-/Sites-mastercatalog_HITES/default/dw9ec95f9c/images/original/calzado-mujer/808253001.jpg?sw=400&sh=400'],
thumbnail: 'https://www.hites.com/dw/image/v2/BDPN_PRD/on/demandware.static/-/Sites-mastercatalog_HITES/default/dw9ec95f9c/images/original/calzado-mujer/808253001.jpg?sw=400&sh=400',
category: 'https://www.hites.com/zapatos/marcas-zapatos/',
categoryName: 'Zapatos -> Marcas Zapatos',
discountPercentage: 88,
discount: 28990,
normalPrice: 32990,
offerPrice: 4000,
cardPrice: 0,
isOutOfStock: false,
isUnavailable: false,
createdAt: 2022-12-16T15:24:26.415+00:00,
version: 2
}