ahaq0 / AmazonScraper

AmazonMe is a web scraper that scrape Amazon product database and save it into excel database.

AmazonMe

Welcome to the AmazonMe scraper that scrape Amazon product database and save it into excel database. This repository contains the code for a web scraper that can extract information from the Amazon website. The scraper uses the Python Playwright library to automate the process of browsing and extracting data from the website. To get started, you will need to have Python and the necessary requirements installed on your machine.

Install virtual environment:

It's always a good practice to install a virtual environment before installing necessary requirements:

python.exe -m venv environmentname
environmentname/scripts/activate

Install necessary requirements:

pip install -r requirements.txt
playwright install

The repository includes the following files:

scraper.py: This is the main script that initiate the automation.
tools.py: This file contains the main code for the scraper.

To run the script, go to terminal....

python scraper.py

After running the program, the scraper will ask you to enter a product url. Do it accordingly and it will scrape the data such as
Product name
ASIN
Prices
Reviews
Links

Please note that the script is designed to work with Amazon and may not work with other types of websites. Additionally, the script may be blocked by the website if it detects excessive scraping activity, so please use it responsibly.

If you have any issues or suggestions for improvements, please feel free to open an issue on the repository or submit a pull request.

Thank you for using the AmazonMe!