Feature Proposal support OpenTelemetry on syslog drains
KarstenSchnitter opened this issue · comments
As a user I would like to receive the logs of my application on OpenTelemetry format so I can create a syslog drain to a standard tool such as the OpenTelemetry Collector.
Using the OpenTelemetry log format will enable log ingestion into a variety of services, e.g. Elasticsearch supports OpenTelemetry out of the box. The metadata currently provided as syslog structured data should be added as resource attributes. See the protobuf definitions for details on the format.
During the registration of the syslog drain url custom certificates should be supported, so that mTLS can be achieved.
We have created an issue in Pivotal Tracker to manage this. Unfortunately, the Pivotal Tracker project is private so you may be unable to view the contents of the story.
The labels on this github issue will be updated when the story is started.
@KarstenSchnitter it sounds like you're asking for application logs to be formatted as OpenTelemetry logs and sent via syslog? Is that right?
@ctlong I'd assume it means opentelemetry INSTEAD OF syslog
@Benjamintf1 in terms of implementation yes, I agree. I was trying - and apparently failing - to articulate that the registered egress of the OpenTelemetry collector would be syslog.
In any case, reimplementing loggregator with OpenTelemetry seems like more effort than it's worth since we're in the process of moving to Shared Nothing. Although it does sound like we need to provide an ingress option for syslog into Elasticsearch. I would probably prefer to find another solution than reimplementing the syslog agent as an OpenTelemetry agent.
Closing due to lack of response. Please feel free to re-open if there's more to do.