A Node based CLI to crawl websites
- Jest - Jest is a JavaScript testing framework designed to ensure correctness of any JavaScript codebase
- JSDOM - JSDOM is a library which parses and interacts with assembled HTML just like a browser
- Axios - Promise based HTTP client for the browser and node.js.
npm i website-crawler-cli
crawl -w https://axios-http.com