itsfadnis / spider

A node js web crawler, which generates metadata/tags for a search string by crawling its google search results.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

spider

Crawls the web, generates tags.

Demo

Try out the demo here

Requirements

  • node js and npm

Usage

  1. Clone the repo git clone https://github.com/itsfadnis/spider.git

  2. Move to the spider directory cd spider

  3. Install dependencies npm install

  4. Start the server npm start

  5. Start crawling by visiting: http://localhost:8080

About

A node js web crawler, which generates metadata/tags for a search string by crawling its google search results.


Languages

Language:JavaScript 89.6%Language:HTML 9.4%Language:CSS 1.0%