Parseable Collector is an automatic log collection system for Parseable. Collector is designed to pull application logs from specific containers (using Kubernetes API). Collector sends collected logs to Parseable server for storage, querying and further analysis.
Why another logging agent?
Log collection has been traditionally done with agents installed on each Kubernetes node. This is too much of installation and compute overhead for most of the use cases. In reality, developers simply want to plug their applications to logging and move on. Collector is designed keeping this in mind.
With Collector we set out to achieve the shortest path between application generating logs and developer analysing those logs.
Get Started
Collector is designed to run on Kubernetes only. We recommend installing Collector via the official helm chart available in this repository. Before deploying the collector, make sure you understand the configuration.
Configuration
Collector takes configuration input in yaml format.
logStreams:
- name: backend
collectionInterval: 3s
collectFrom:
namespace: streaming
podSelector:
app: kafka
labels:
app: kafka
namespace: streaming