#Node.js #puppeteer
This is a demo web crawler for a website (link : http://books.toscrape.com) I've used puppeteer to scrape all the data.
Functionalities are:
- setup browser instance
- scrape all book Urls from landing page.
- from that urls, by crawling, gathered all book information individually
- check for pagnation and automates if pagination exist and gathered data
- scraped data by single category with pagination
- scraped data by multiple category with pagination
- save scraped data in json string on local storage