DEPRECATION NOTICE
This repository has been deprecated. Use https://github.com/newrelic/helm-charts instead.
New Relic Kubernetes logging
Welcome to the New Relic Fluent Bit output plugin for Kubernetes! There are only a few quick steps to getting this working in your cluster.
Usage
Deploying as Helm chart (Recommended)
- Clone this repo
- Deploy the chart using your New Relic license key:
helm install --set licenseKey=(your-license-key),clusterName=(your-cluster-name) ./helm/newrelic-logging
- If you are in the EU, make sure that the license key you are using is an EU key. You will not need to specify the EU logging endpoint -- it will be inferred from the license key
- Check New Relic for your logs
Applying k8s manifests manually
- Clone this repo
- Configure the plugin. In
new-relic-fluent-plugin.yml
:- Specify your New Relic license key in the value for
LICENSE_KEY
- Specify your Kubernetes cluster name in the value for
CLUSTER_NAME
- If you are in the EU:
- Override the
ENDPOINT
environment variable tohttps://log-api.eu.newrelic.com/log/v1
- Make sure that the license key you are using is an EU key
- Override the
- Specify your New Relic license key in the value for
- From this directory, run
kubectl apply -f .
on your cluster - Check New Relic for your logs
Find and use your data
For how to find and query your data in New Relic, see Find log data.
For general querying information, see:
Configuration notes
We default to tailing /var/log/containers/*.log
. If you want to change what's tailed, just update the PATH
value in new-relic-fluent-plugin.yml
.
Parsing
We currently support parsing json and docker logs. If you want more parsing, feel free to add more parsers in fluent-conf.yml
.
Here are some parsers for your parsing pleasure.
[PARSER]
Name apache
Format regex
Regex ^(?<host>[^ ]*) [^ ]* (?<user>[^ ]*) \[(?<time>[^\]]*)\] "(?<method>\S+)(?: +(?<path>[^\"]*?)(?: +\S*)?)?" (?<code>[^ ]*) (?<size>[^ ]*)(?: "(?<referer>[^\"]*)" "(?<agent>[^\"]*)")?$
Time_Key time
Time_Format %d/%b/%Y:%H:%M:%S %z
[PARSER]
Name apache2
Format regex
Regex ^(?<host>[^ ]*) [^ ]* (?<user>[^ ]*) \[(?<time>[^\]]*)\] "(?<method>\S+)(?: +(?<path>[^ ]*) +\S*)?" (?<code>[^ ]*) (?<size>[^ ]*)(?: "(?<referer>[^\"]*)" "(?<agent>[^\"]*)")?$
Time_Key time
Time_Format %d/%b/%Y:%H:%M:%S %z
[PARSER]
Name apache_error
Format regex
Regex ^\[[^ ]* (?<time>[^\]]*)\] \[(?<level>[^\]]*)\](?: \[pid (?<pid>[^\]]*)\])?( \[client (?<client>[^\]]*)\])? (?<message>.*)$
[PARSER]
Name nginx
Format regex
Regex ^(?<remote>[^ ]*) (?<host>[^ ]*) (?<user>[^ ]*) \[(?<time>[^\]]*)\] "(?<method>\S+)(?: +(?<path>[^\"]*?)(?: +\S*)?)?" (?<code>[^ ]*) (?<size>[^ ]*)(?: "(?<referer>[^\"]*)" "(?<agent>[^\"]*)")?$
Time_Key time
Time_Format %d/%b/%Y:%H:%M:%S %z
Legal
This project is provided AS-IS WITHOUT WARRANTY OR SUPPORT, although you can report issues and contribute to the project here on GitHub.