This project has two parts:
- Install NPM packages in a new project/directory: npm install express cors
- add server.js to the root of the same directory
- start the server by using the following command in your terminal: node server
- Copy and paste the contents of this file into the console view of the browser.
- Press Enter
The script will crawl from the injected page until it runs out of pages within the same domain, or until the crawl limit has been reached. There is a semi-random delay timer that fluctuates the wait time between requests, lessening the chance of exceeding rate limits and/or getting robo-banned.