jacygao / spiderman

A simple web crawler that crawls a website n-links deep and calculate the number of unique rendered words found on each page and in total.

Geek Repo

Github PK Tool