awslabs / flowgger

A fast data collector in Rust

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Multiple inputs

gyscos opened this issue · comments

Especially with file input (#20), it may be desirable to merge the logs from multiple sources (each with their own decoder).

Hi,

It might not be convenient if you have many sources, but this can be achieved by having a flowgger instance for each source, the output of these flowgger instances being in the same format (presumaly capnp for efficiency) and sent to a single flowgger instance that collects and aggregates everything.

We restarted active development of Flowgger recently. Is this something still needed or the workaround @jedisct1 suggested is enough for you?