hami-sh / CompareTheBrew

Website, Crawler & Pipeline to collate prices of alcoholic beverages to discover the most efficient drinks!

Home Page:http://comparethebrew.me

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CompareTheBrew.me

🍺🍺 Get the cheapest drink possible across all Aussie alcoholic vendors 🍺🍺

Setup:

$ bash setup.sh

API Queries:

http://comparethebrew.me/api?term=TERM&order=score_desc

Run:

SCRAPING

locally
$ python3 scrape.py [store] [category] [# pages]

-> store (bws, others not implemented yet)

-> category (beer, wine, spirits)

-> # pages (0 for all)

lightsail instance (done automatically via cron)
$ pipeline.sh

WEB SERVER

locally
$ python3 app.py
lightsail instance
$ ./startserver.sh
$ ./seeserver.sh
$ ./killserver.sh

Dependancies (installed in setup)

  • BeautifulSoup4
  • Selenium
  • ChromeWebDriver (headless)
  • flask
  • sqlite3

Made Possible by:

Hamish Bultitude

Matt Costello

Alex Nicholson

About

Website, Crawler & Pipeline to collate prices of alcoholic beverages to discover the most efficient drinks!

http://comparethebrew.me


Languages

Language:Python 35.0%Language:CSS 33.0%Language:HTML 27.6%Language:JavaScript 2.7%Language:Shell 1.7%