Giters

bersling / grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This repository is not active

About

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

License:Other

Languages

Language:Python 51.0%Language:HTML 48.1%Language:Shell 0.8%