awslabs / flowgger

A fast data collector in Rust

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[question] any plans to be able to push directly to elasticsearch ?

bobymicroby opened this issue · comments

Hi Boris,

Yes, this is definitely planned (and pull requests are welcome to make it happen sooner!)

Support for the Beats serialization format is also planned.

That's awesome !

On Sat, Oct 8, 2016, 18:24 Frank Denis notifications@github.com wrote:

Hi Boris,

Yes, this is definitely planned (and pull requests are welcome to make it
happen sooner!)

Support for the Beats serialization format is also planned.


You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#11 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA4nVydwBuYzmDStgdGNariD5nVMZ-Orks5qx7W0gaJpZM4KRuDg
.

While the implementation is not complete, you can try to use fluentbit/hindsight.

I would like to take this, if no one already started implementing it

Go for it!

I check available libraries a bit and I didn't found any, which supports Elastic 6.x. There is https://github.com/elastic-rs/elastic for Elastic 5.x.
But I believe we will need only the index operation (with bulk), so I could use some HTTP library and implement support for 6.x.

@jedisct1 WDYT? The Elasticsearch API's are not backward compatible between major releases and we need to decide which one to support.

I see that https://github.com/elastic-rs/elastic supports now Elasticsearch 7.x, so I think it would be worth to look on this issue again.