lionelcao / logstorm

[WIP] A library run native logstash in Distributed Streaming Environment like Storm and Spark Streaming

Home Page:http://haoch.github.io/logstorm/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

LogStorm

Prerequisites

Documentation

You can find the more documentation on docs. This README file only contains basic setup instructions.

Getting Started

Bootstrap from source code and run examples

./build/bootstrap-example.sh

Development

  • Build with source code

      git clone git@github.com:haoch/logstorm.git
      cd logstorm
      mvn install
    
  • Start LogStorm Server:

      mvn exec:java -pl server -Dexec.mainClass="com.ebay.logstorm.server.LogStormServer" -Dserver.port=8080
    

Test

  • Run all unit tests

      mvn test
    
  • Test single test, for example TestStormPipelineRunner

      mvn test -Dtest=com.ebay.logstorm.runner.storm.TestStormPipelineRunner -DfailIfNoTests=false
    
  • Test sample pipeline through REST API

      ./examples/scripts/run-sample-pipeline.sh
    

Code Style

Contact

  • @haoch (hao at apache dot org)

About

[WIP] A library run native logstash in Distributed Streaming Environment like Storm and Spark Streaming

http://haoch.github.io/logstorm/


Languages

Language:Java 81.7%Language:HTML 8.7%Language:JavaScript 5.3%Language:Ruby 2.4%Language:Shell 1.8%Language:CSS 0.0%