This Python script scrapes this URL. It collects information such as the product URL, name, price, rating, number of reviews, product description, ASIN, and manufacturer. The scraped data is then exported to a CSV file.
To run this script, you need to have the following installed:
- Python 3.x
requests
librarybeautifulsoup4
librarypandas
library
You can install the required libraries using pip:
pip install requests beautifulsoup4 pandas
-
Clone this repository to your local machine or download the
scrape_products.py
file. -
Make sure you have the required libraries installed as mentioned in the Requirements section.
-
Open the terminal or command prompt and navigate to the directory where the
scrape_products.py
file is located. -
Run the script using the following command:
python scrape_products.py
-
The script will start scraping the product data from Amazon's search results. It will then proceed to scrape individual product pages for additional information.
-
After completing the scraping process, the script will create a CSV file named
amazon_products.csv
in the same directory, containing all the scraped data.