jasimmonsv / pyCrawler

Python Web Crawler from Udacity's CS101

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This script will crawl a web pages links (specified by the seed global variable) and build a tree list 
and then proceed to crawl those links within the scope of being on the accepted servers list.

Execution instructions:
During this iteration, you will need to change the seed in the code to crawl the site you want and list of accepted servers.

About

Python Web Crawler from Udacity's CS101


Languages

Language:Python 100.0%