stormcrawler

There are 1 repository under stormcrawler topic.

• apache / stormcrawler

  A scalable, mature and versatile web crawler based on Apache Storm

  web-crawlerapache-stormdistributedjavacrawlerstormcrawler
  Language:Java 946

• DigitalPebble / stormcrawler-docker

  Resources for running StormCrawler with Docker services

  stormcrawlerdockerapache-storm
  Language:Dockerfile 9

• sebastian-nagel / warc-crawler

  Process web archives (WARC format) with StormCrawler and index content into Elasticsearch or Solr

  stormcrawlerapache-stormwarc-filesweb-archiveselasticsearchsolrwarc
  Language:FLUX 8

• DigitalPebble / ansible-storm

  Ansible playbook for deploying a Storm cluster

  stormstormcrawleransibleplaybook
  7

• DigitalPebble / benchmark

  StormCrawler topology to evaluate the performance of different backends and configurations

  benchmarkelasticsearchopensearchstormcrawler
  Language:Shell

• ngramp / stormcrawlnlp

  stormcrawleropennlp
  Language:Java