luiscruzga / offersChile

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Ofertas Chile

Get the best offers and promotions from different online stores in Chile so you can take advantage of the best discounts

The system is in charge of carrying out web scraping to the different online stores in search of the best offers and these are stored in a mongodb database for later use in other systems.

In addition, it allows you to inform about offers through a telegram channel.

Previous Requirements

It is required to have previously installed the following

nodejs >= 14.x

mongodb >= 5.x

postgresql

Installation

Install this project with npm

  npm install

Run Locally

Clone the project

  git clone https://github.com/luiscruzga/offersChile

Go to the project directory

  cd offersChile

Install dependencies

  npm install

Start the server

  npm start

Once finished, you will be able to review the offers in the DB (by default it is hosted at mongodb://localhost/storePromotions)

Stores

Stores from which promotions are currently obtained

Store Url Time(minutes)
Abcdin https://www.abcdin.cl 1
Adidas https://www.adidas.cl 7
Best Store https://www.beststore.cl 2
CIntegral https://cintegral.cl 2
Dafiti https://www.dafiti.cl 1
Decathlon https://www.decathlon.cl 1
Easy https://www.easy.cl 11
El Container https://www.elcontainer.cl 1
Entel https://miportal.entel.cl 1
Falabella https://www.falabella.com/falabella-cl 74
Hites https://www.hites.com 27
Jumbo https://www.jumbo.cl 9
Knasta https://knasta.cl 2
La Barra https://labarra.cl 1
La Polar https://www.lapolar.cl 10
Lider https://www.lider.cl/catalogo 10
Lider-Supermercado https://www.lider.cl/supermercado/ 10
Movistar https://catalogo.movistar.cl 2
Olimpo Sports https://olimposports.cl 1
Paris https://www.paris.cl 88
Ripley https://simple.ripley.cl 3
Santa Isabel https://www.santaisabel.cl 7
Tricot https://www.tricot.cl 2
WOM https://store.wom.cl 1

Note: these times can be further reduced by modifying the default delay times in the configuration file, but keep in mind that cpu consumption can skyrocket if not controlled correctly given the parallelism that occurs

Products saves

The products are stored in the DB as follows

{
  store: 'Hites',
  sku: '808253002',
  name: 'Zapatilla Urbana Chunky Mujer Rolly Go',
  description: 'Zapatilla Urbana Chunky Mujer Rolly Go',
  brand: 'ROLLY GO',
  url: 'https://www.hites.com/zapatilla-urbana-chunky-mujer-rolly-go-808253002.html',
  images: ['https://www.hites.com/dw/image/v2/BDPN_PRD/on/demandware.static/-/Sites-mastercatalog_HITES/default/dw9ec95f9c/images/original/calzado-mujer/808253001.jpg?sw=400&sh=400'],
  thumbnail: 'https://www.hites.com/dw/image/v2/BDPN_PRD/on/demandware.static/-/Sites-mastercatalog_HITES/default/dw9ec95f9c/images/original/calzado-mujer/808253001.jpg?sw=400&sh=400',
  category: 'https://www.hites.com/zapatos/marcas-zapatos/',
  categoryName: 'Zapatos -> Marcas Zapatos',
  discountPercentage: 88,
  discount: 28990,
  normalPrice: 32990,
  offerPrice: 4000,
  cardPrice: 0,
  isOutOfStock: false,
  isUnavailable: false,
  createdAt: 2022-12-16T15:24:26.415+00:00,
  version: 2
}

Authors

About


Languages

Language:JavaScript 100.0%