Flipkart Review Scrapper

This is a flask based app to scrap user reviews and comments from a retail website and generates word-cloud with CSV data. The data that was gathered is available to download as well.

Prerequisites

Environment setup.

conda create --prefix ./env python=3.8 -y
conda activate ./env

Install Requirements

pip install -r requirements.txt

Run setup to make internal packages usable

pip install -e .

Run App windows

python app.py

Mac/linux

python3 app.py

Docker Integration

Build Image

docker build -t Image_name .

Create and run container

docker run -p 8000:8080 Image_name

Stop running container

docker stop container_ID

Start container

docker start container_ID

Flow Chart

Project Folder structure

├── scraper/
│   ├── data_access/
│   │   ├── __init__.py
│   │   └── data_access.py
│   ├── enitity/
│   │   ├── __init__.py
│   │   └── entity.py
│   ├── exception/
│   │   ├── __init__.py
│   │   └── exception.py
│   ├── logging/
│   │   ├── __init__.py
│   │   └── logging.py
│   ├── logic/
│   │   ├── __init__.py
│   │   └── business_logic.py
│   ├── tests/
│   │   ├── __init__.py
│   │   └── tests.py
│   └── utils/
│       └── __init__.py
└── __init__.py