ganzerli / crowler-for-words

Crowling domain, cut style, script and all HTML tags, gets words and links, following all links and printing all the words found into a file separated by space

All words from all links found in a domain are saved into a file

Using lcurl, you need to install first lcurl

Crowling domain: -cuts all style -cuts all script -cuts all HTML tags -gets all words -gets all links -formats all links -calls all links -saves all words found in the html into a file

Compile in linux with: gcc -o crowler crowler.c -lcurl