crawler-indexer
| Branch | Status |
|---|---|
master |
 |
develop |
 |
A crawling and indexing library to build crawlers and indexers with.
Getting Started
Install the module with: npm install crawler-indexer
var Crawler = require('crawler-indexer').Crawler;
var Indexer = require('crawler-indexer').Indexer;
var indexer = Indexer.create(options, overrides);
indexer.start();
var crawler = Crawler.create(options, overrides);
crawler.start();Documentation
(Coming soon)
Examples
(Coming soon)
Contributing
In lieu of a formal styleguide, take care to maintain the existing coding style. Add unit tests for any new or changed functionality. Lint and test your code using Grunt.
Release History
(Nothing yet)
License
Copyright (c) 2014 Niels Henrik Hagen. Licensed under the MIT license.