freedomflyer / webcrawler

A C++ Webcrawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

> By Spencer Gardner
  > A webcrawler that crawls based off of a given url to the links that are on that URL, and thereafter recurisvely crawls the links that follow.
  > Uses custom datastructures to store and count unique words found on each page.
  > Be careful which URL is specified!

About

A C++ Webcrawler


Languages

Language:C++ 80.9%Language:Objective-C 10.9%Language:Shell 6.9%Language:Perl 0.6%Language:ASP 0.3%Language:PHP 0.1%Language:ColdFusion 0.1%Language:JavaScript 0.0%Language:C 0.0%