vetcher / pagedownloader

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

PageDownloader

This tool provides download list of web pages with using sitemap, or it may download target page

Usage

  • settings.cfg and url.cfg uses JSON structure for initialize program
  • To add link for sitemap or target page, add it as element of array to urls.cfg in section Lists for sitemaps and Pages for target links

Settings

  • delay - delay between processing last page and download next (integer > 0)
  • multi_thread - this setting in progress
  • logmode - how detailed should be log messages (0-3)
  • logswitch - on or off log (true / false)

About

License:MIT License


Languages

Language:Go 100.0%