areejeweida / Data-Mining-

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

image

OpenTable Scarper

This project will scrape, clean, and analyze 100 best restaurants in America for 2017.

Overview

  • The data is retrieved and parsed from OpenTable web (main URL: https://www.opentable.com/m/best-restaurants-in-america-for-2017/) via a Beautiful Soup and Requests packages.
  • Data is then cleaned and built in Python.
  • Data is written to a MySQL database via PyMySQL connection.
  • The data is deployed on an EC2 instance in AWS.
  • Finally, the data is placed in ReDash for BI Analysis.

Project Status

  • Build Status

Flowchart

alt text

Requirements

Installation

This file should be downloaded to later install it like:

pip install -r requirements.txt

Authors

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

About


Languages

Language:Python 100.0%