logsearch
A scalable stack of Elasticsearch, Logstash, and Kibana for your own BOSH-managed infrastructure.
- Multiple Protocols - to receive logs via syslog (+TLS), relp, or lumberjack
- Queue - to buffer against surges of log messages
- Custom Parsing - to extract the fields from your own application-specific log format via logstash filters
- Search - to find, aggregate, and report on those fields via elasticsearch
- Visualize - to create and share dashboards of your logs via kibana
- Archive - to retain log messages compressed and offsite in long-term storage via Amazon S3 or SFTP
- Curator - to set log retention
Getting Started
Upload the latest logsearch release from bosh.io...
$ bosh upload release https://bosh.io/d/github.com/logsearch/logsearch-boshrelease
If you are using bosh-lite, you can
get started with our sample manifest, bosh-lite.yml...
$ bosh -d templates/bosh-lite.yml deploy
For more details, review the docs/
or raise an issue if you run into a bug.
Testing
To run a sanity test which ships some sample logs, parses, and then queries them,
use the pre-configured test_e2e_errand errand from templates/bosh-lite.yml...
$ bosh -d templates/bosh-lite.yml run errand test_e2e_errand
...snip...
==> Validating results...
SUCCESS
To run tests for logsearch-shipper integration, run the included script...
$ ./bin/logsearch-shipper-config-buildtest
...snip...
SUCCESS