loyal812 / rust-amazon-topsellers

This program will scrape the title, link, rating, and number of comments from the Amazon bestsellers page and save extracted data to a bestsellers.csv file.

Amazon bestsellers demo

This program will scrape the title, link, rating, and number of comments from the Amazon bestsellers page and save extracted data to a bestsellers.csv file.

It uses a Selenium / WebDriver method of extraction.

Try it out!

1. Install Rust
2. Install geckodriver:

$ cargo install geckodriver

3. Optionally, on X11 you can install virtual framebuffer Xvfb to hide the puppet browser:

# On Debian/Ubuntu
$ sudo apt install xvfb
# On Fedora
$ yum install xorg-x11-server-Xvfb

4. Optionally, change the default setting in the config.toml file.
5. Run the app:

# This will start a virtual frame buffer :99, start geckodriver, compile, and run the scraper
$ ./scripts/start.sh

After the extraction's finished you'll find all extracted data in the bestsellers.csv file.