mariomarin / fluent-bit

Fast and Lightweight Log processor and forwarder for Linux, BSD and OSX

Home Page:http://fluentbit.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Travis CI: Build Status

GitLab CI: pipeline status

Fluent Bit is a Data Forwarder for Linux, Embedded Linux, OSX and BSD family operating systems. It's part of the Fluentd Ecosystem. Fluent Bit allows collection of information from different sources, buffering and dispatching them to different outputs such as Fluentd, Elasticsearch, Nats or any HTTP end-point within others. It's fully supported on x86_64, x86 and ARM architectures.

For more details about it capabilities and general features please visit the official documentation:

https://docs.fluentbit.io/

Quick Start

$ cd build
$ cmake ..
$ make
$ bin/fluent-bit -i cpu -o stdout

Features

Fluent Bit support the following features through plugins:

Input plugins

name option description
CPU cpu gather CPU usage between snapshots of one second. It support multiple cores
Disk disk usage of block device
Dummy dummy generates dummy event
Exec exec executes external program and collects event logs
Forward forward Fluentd forward protocol
Memory mem usage of system memory
MQTT mqtt start a MQTT server and receive publish messages
Netif netif usage of network interface
Kernel Ring Buffer kmsg read Linux Kernel messages, same behavior as the dmesg command line program
Syslog syslog read messages from a syslog daemon
Systemd/Journald systemd read messages from journald, part of the systemd suite
Serial Port serial read from serial port
Standard Input stdin read from the standard input
Head head read first part of files
Health health check health of TCP services
Process proc check health of Process
Random random generate random numbers
Tail tail tail log files
TCP tcp listen for raw JSON map messages over TCP

Filter Plugins

name option description
Record Modifier record_modifier Append/Remove key-value pair
Grep grep Match or exclude specific records by patterns
Nest nest Nest specific records by patterns
Kubernetes kubernetes Enrich logs with Kubernetes Metadata
Stdout stdout Print records to the standard output interface
Parser parser Parse records

Output Plugins

name option description
Counter counter count records
Elasticsearch es flush records to a Elasticsearch server
File file flush records to a file
FlowCounter flowcounter count records and its size
Forward forward flush records to a Fluentd service. On the Fluentd side, it requires an in_forward.
NATS nats flush records to a NATS server
HTTP http flush records to a HTTP end point
InfluxDB influxdb flush records to InfluxDB time series database
Plot plot generate a file for gnuplot
Standard Output stdout prints the records to the standard output stream
Treasure Data td flush records to Treasure Data service (cloud analytics)

Official Documentation

The official documentation of Fluent Bit can be found in the following site:

http://fluentbit.io/documentation/

Contributing

In order to contribute to the project please refer to the CONTRIBUTING guidelines.

Contact

Feel free to join us on our Slack channel, Mailing List or IRC:

License

This program is under the terms of the Apache License v2.0.

Authors

Fluent Bit is made and sponsored by Treasure Data among other contributors.

About

Fast and Lightweight Log processor and forwarder for Linux, BSD and OSX

http://fluentbit.io/

License:Apache License 2.0


Languages

Language:C 74.6%Language:C++ 15.5%Language:Shell 2.1%Language:Objective-C 2.0%Language:Lua 1.2%Language:CMake 0.9%Language:HTML 0.8%Language:Python 0.8%Language:Makefile 0.7%Language:Perl 0.5%Language:M4 0.4%Language:Ruby 0.2%Language:Roff 0.1%Language:JavaScript 0.1%Language:Yacc 0.1%Language:Batchfile 0.0%Language:CSS 0.0%Language:Lex 0.0%Language:BitBake 0.0%Language:Dockerfile 0.0%Language:PowerShell 0.0%Language:Java 0.0%Language:sed 0.0%Language:XSLT 0.0%Language:Awk 0.0%Language:Emacs Lisp 0.0%Language:Tcl 0.0%