The goal of this project is to scrap customer reviews from amazon
- You can use this data to analyze the product
- Discover insights into consumer reviews
Python
- Splash
- BeautifulSoup
- Requests
- Pandas
Python Development
- Visual Studio Code
-
Splash is a lightweight browser, has a HTTP API built in where we can send our request and it returns the information
-
Install docker
sudo apt install docker*
-
Install Splash
sudo docker pull scrapinghub/splash
-
Start Splah service in docker
sudo docker run -p 8050:8050 -p 5023:5023 scrapinghub/splash
-
Import Python Libraries
import requests
from bs4 import BeautifulSoup
import pandas as pd
- Save the data into DataFrame
df = pd.DataFrame(reviewlist)
df.to_excel('Maono AU-MH601 Professional.xlsx', index=False)