benbuckman / scrape-links

Scrape links recursively from a URL

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CLI script to scrape links from a website

npm install -g scrape-links

Usage: scrape-links --url URL --out FILE --max-depth N
Scrapes all links, recursively loading each found link on the same domain.

Options:
  --url        initial URL to scrape                   [required]
  --out        file to write URLs
  --max-depth  Scrape only this number of pages deep.

About

Scrape links recursively from a URL


Languages

Language:JavaScript 100.0%