newrelic / opentelemetry-exporter-java

An OpenTelemetry exporter that sends telemetry to New Relic

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Archived header

Archival Notice

❗Notice: This project has been archived as is and is no longer actively maintained.

Rather than developing a Java specific OpenTelemetry exporter New Relic has adopted a language agnostic approach that facilitates data collection from all OpenTelemetry data sources.

The current recommended approaches for sending OpenTelemetry data to the New Relic platform are as follows:

  • Configure your OpenTelemetry data source to send data to the OpenTelemetry Collector using the OpenTelemetry Protocol (OTLP) and configure the collector to forward the data using the New Relic collector exporter.
  • Configure your OpenTelemetry data source to send data to the native OpenTelemetry Protocol (OTLP) data ingestion endpoint. OTLP is an open source gRPC based protocol for sending telemetry data. The protocol is vendor agnostic and open source.

For more details please see:


New Relic OpenTelemetry exporter

An OpenTelemetry exporter for sending spans and metrics to New Relic using the New Relic Java Telemetry SDK.

For the details on how OpenTelemetry data is mapped to New Relic data, see documentation in Our exporter specifications documentation

How to use

The New Relic OpenTelemetry exporter can be used in two capacities:

  1. Programmatically - an application takes a dependency on the exporter library, and manually invokes its APIs to report OpenTelemetry data to New Relic.
  2. Auto Instrumentation - configure an application to use the OpenTelemetry Java Agent for automatic instrumentation, and report the data to New Relic via the exporter.

In either case, to send the resulting spans and metrics to New Relic, you will need an Insights Insert API Key.

Programmatic Usage

The New Relic OpenTelemetry exporter can be used programmatically, allowing an application to invoke its APIs as needed to report OpenTelemetry data to New Relic.

The workflow for programmatic use is as follows:

  • Create exporters for the data types to be reported. The exporter currently supports spans and metrics.
  • Register the exporters using OpenTelemetry APIs.
  • Use the OpenTelemetry APIs to record data, which will be exported to New Relic.
  • At the end of the application's lifecycle, call shutdown APIs to stop OpenTelemetry and exporter activity.

BasicExample.java gives a good end to end demonstration of this workflow. It should be considered the canonical code for this type of workflow since OpenTelemetry internal SDK APIs are still a work in progress.

The easiest way to get started using the OpenTelemetry SDK with the New Relic exporters is as follows:

Add required dependencies in build.gradle (see Published Artifacts for versions):

repositories {
    maven {
        url = "https://oss.sonatype.org/content/repositories/snapshots"
    }
}

dependencies {
    implementation("com.newrelic.telemetry:opentelemetry-exporters-newrelic:{version}")
    implementation("io.opentelemetry:opentelemetry-sdk:{version}")
    implementation("com.newrelic.telemetry:telemetry-core:{version")
    implementation("com.newrelic.telemetry:telemetry-http-okhttp:{version}")
}

Use the provided APIs in your application to set up exporters to record and send OpenTelemetry trace and metric data:

    // Configure the New Relic exporters.
    NewRelicExporters.Configuration configuration =
        new NewRelicExporters.Configuration(apiKey, "My Service Name")
            .enableAuditLogging() // Optionally enable audit logging
            .collectionIntervalSeconds(
                10); // Set the reporting interval for metrics/spans to 10 seconds

    // Start the exporters with the supplied configuration. This starts both a NewRelicSpanExporter
    // and a NewRelicMetricExporter as well as a BatchSpanProcessor and an IntervalMetricReader, the
    // latter of which manage the batching and sending of their respective telemetry data types.
    NewRelicExporters.start(configuration);

    // Now that we've got the SDK configured and the exporters started, let's write some very simple
    // instrumentation to demonstrate how it all works.

    // Call the OpenTelemetry SDK to obtain tracers and meters to record data.
    // A Tracer is used to create Spans that form traces.
    Tracer tracer = OpenTelemetry.getGlobalTracerProvider().get("sample-app", "1.0");
    // A Meter is used to create different instruments to record metrics.
    Meter meter = OpenTelemetry.getGlobalMeterProvider().get("sample-app", "1.0");

    // Use the tracer and meter to record telemetry data for your application. See the sections 
    // in the README on Recording Spans and Recording Metrics for specific usage examples. 

    // When the application is complete, be sure to call shutdown to stop the exporters.
    // This will flush any data from the exporters before they exit.
    NewRelicExporters.shutdown();

The previous example hides some boilerplate code that can be further customized if more flexibility is required. Specifically the call to NewRelicExporters.start(configuration) automatically starts both a NewRelicSpanExporter and a NewRelicMetricExporter for you using the same configuration for both. If you wish to configure each exporter separately, or simply don't need to export both spans and metrics, then Recording Spans and Recording Metrics sections describe how to do this as well as how to use the Tracer and Meter APIs to record telemetry data.

Recording Spans

BasicExample.java demonstrates the easiest way to configure the span exporter. If your application needs more flexibility, it can be further configured as follows (see the NewRelicSpanExporter and BatchSpanProcessor APIs for all configuration options):

    // Explicitly create and configure a NewRelicSpanExporter.
    NewRelicSpanExporter exporter =
        NewRelicSpanExporter.newBuilder()
            .apiKey(System.getenv("INSIGHTS_INSERT_KEY"))
            .commonAttributes(new Attributes().put(SERVICE_NAME, "best service ever"))
            .build();

    // Use the NewRelicSpanExporter to create and configure a BatchSpansProcessor.
    BatchSpanProcessor spanProcessor =
        BatchSpanProcessor.builder(exporter)
            .setScheduleDelayMillis(10_000) // Optionally override the default schedule delay
            .build();

    // Register the span processor with the default TracerSdkManagement of the OpenTelemetrySdk.
    OpenTelemetrySdk.getGlobalTracerManagement().addSpanProcessor(spanProcessor);

Once the span exporter has been registered with the OpenTelemetrySdk, spans can be recorded as follows:

    // Create an OpenTelemetry Tracer and use it to record spans.
    Tracer tracer = OpenTelemetry.getGlobalTracerProvider().get("sample-app", "1.0");

    Span span = tracer.spanBuilder("testSpan").setSpanKind(Span.Kind.INTERNAL).startSpan();
    try (Scope scope = span.makeCurrent()) {
        // do some work
    } catch (Throwable t) {
        span.setStatus(StatusCode.ERROR, "error description"); // record error details.
    } finally {
        span.end(); // closing the scope does not end the span, this has to be done manually.
    }

Find your spans in New Relic One: go to New Relic One and select Distributed Tracing.

Recording Metrics

BasicExample.java demonstrates the easiest way to configure the metric exporter. If your application needs more flexibility, it can be further configured as follows (see the NewRelicMetricExporter and IntervalMetricReader APIs for all configuration options):

    // Explicitly create and configure a NewRelicMetricExporter.
    MetricExporter metricExporter =
        NewRelicMetricExporter.newBuilder()
          .apiKey(System.getenv("INSIGHTS_INSERT_KEY"))
          .commonAttributes(new Attributes().put(SERVICE_NAME, "best service ever"))
          .build();

    // Use the NewRelicMetricExporter to create and configure an IntervalMetricReader.
    IntervalMetricReader intervalMetricReader =
        IntervalMetricReader.builder()
            .setMetricProducers(
                Collections.singleton(OpenTelemetrySdk.getGlobalMeterProvider().getMetricProducer()))
            .setExportIntervalMillis(5000) // Batch up metrics every 5 seconds, or on whatever schedule the application requires
            .setMetricExporter(metricExporter)
            .build();

Once the IntervalMetricReader has been setup with the metric exporter, metrics can be recorded as follows:

    // A Meter is used to create different instruments to record metrics.
    Meter meter = OpenTelemetry.getGlobalMeterProvider().get("sample-app", "1.0");

    // Use the meter to create a LongCounter instrument to record metrics.
    LongCounter spanCounter =
        meter
            .longCounterBuilder("spanCounter")
            .setUnit("one")
            .setDescription("Counting all the spans")
            .build();

    // Use the meter to create a LongValueRecorder instrument to record metrics.
    LongValueRecorder spanTimer =
        meter
            .longValueRecorderBuilder("spanTimer")
            .setUnit("ms")
            .setDescription("How long the spans take")
            .build();
    
    // Use the meter to create a LongUpDownCounter instrument to record metrics.
    LongUpDownCounter upDownCounter =
        meter
            .longUpDownCounterBuilder("jim")
            .setDescription("some good testing")
            .setUnit("1")
            .build();

    // Use the instruments to record metric measurements.
    spanCounter.add(1, Labels.of("spanName", "testSpan", "isItAnError", "" + markAsError));
    upDownCounter.add(random.nextInt(100) - 50);

    // Optionally, you can pre-bind a set of labels, rather than passing them in every time.
    LongValueRecorder.BoundLongValueRecorder boundTimer = spanTimer.bind(Labels.of("spanName", "testSpan"));
    boundTimer.record(System.currentTimeMillis() - startTime);

To find your metrics in New Relic One, go to New Relic One and locate your service in the Entity explorer (based on the "service.name" attributes you've used).

Auto Instrumentation Usage

In order to automatically instrument an application, it must be configured to use the OpenTelemetry Java Agent and to use the New Relic OpenTelemetry exporter by passing several options to the java [options] -jar <mainclass>> [args..] command.

The OpenTelemetry Java Agent must be downloaded (various versions available here), and specified via:

-javaagent:path/to/opentelemetry-javaagent-<version>-all.jar

The New Relic OpenTelemetry Exporter must be downloaded (various versions available here), and specified via:

-Dotel.exporter.jar=path/to/opentelemetry-exporter-newrelic-auto-<version>.jar

A New Relic Insights Insert API key must be specified via:

-Dnewrelic.api.key=${INSIGHTS_INSERT_KEY}

The application's service name should be specified via:

-Dnewrelic.service.name=best-service-ever

The configuration can be optionally further customized using the available system properties.

Bringing it all together, the command to run the application will look something like:

java -javaagent:path/to/opentelemetry-javaagent-<version>-all.jar \
     -Dotel.exporter.jar=path/to/opentelemetry-exporter-newrelic-auto-<version>.jar \
     -Dnewrelic.api.key=${INSIGHTS_INSERT_KEY} \
     -Dnewrelic.service.name=best-service-ever \
     -jar myapp.jar

⚠️ If you encounter an error like this:

[main] WARN io.opentelemetry.auto.tooling.TracerInstaller - No span exporter found in opentelemetry-exporters-newrelic-auto-0.8.1.jar

Check our release notes and verify the version of your opentelemetry-exporter-newrelic-auto-<version>.jar supports the version of opentelemetry-javaagent-all.jar.

Configuration System Properties

Currently, the New Relic OpenTelemetry exporter supports the following configuration via system properties.

System property Purpose
newrelic.api.key [Required] The Insights insert key to report telemetry data to New Relic.
newrelic.service.name [Recommended] The service name of this JVM instance, default is (unknown service).
newrelic.trace.uri.override The New Relic endpoint to connect to for reporting Spans, default is US Prod. For the EU region use: https://trace-api.eu.newrelic.com/trace/v1
newrelic.metric.uri.override The New Relic endpoint to connect to for reporting metrics, default is US Prod. For the EU region use: https://metric-api.eu.newrelic.com/metric/v1
newrelic.enable.audit.logging Enable verbose audit logging to display the JSON batches sent each harvest.
io.opentelemetry.javaagent.slf4j.simpleLogger.log.com.newrelic.telemetry=debug Enable debug logging for the exporter when running in the auto-instrumentation agent.

Published Artifacts

This project publishes two artifacts in alignment with the two workflows for using the exporter described in How to use:

Group Name Link Description
com.newrelic.telemetry opentelemetry-exporters-newrelic Maven For Programmatic Usage
com.newrelic.telemetry opentelemetry-exporters-newrelic-auto Maven For Auto Instrumentation Usage

Release notes are available here.

Javadoc for this project can be found here: Javadocs

Find and use your data

For tips on how to find and query your data in New Relic, see Find trace/span data.

For general querying information, see:

Building

Requires Java 8+ to build.

CI builds are run on Github Actions:

PR build

Here are the current and past runs of the PR build action.

The project uses gradle 5 for building, and the gradle wrapper is provided.

To compile, run the tests and build the jar:

$ ./gradlew build

Support

Should you need assistance with New Relic products, you are in good hands with several support channels.

If the issue has been confirmed as a bug or is a feature request, file a GitHub issue.

Support Channels

Privacy

At New Relic we take your privacy and the security of your information seriously, and are committed to protecting your information. We must emphasize the importance of not sharing personal data in public forums, and ask all users to scrub logs and diagnostic information for sensitive information, whether personal, proprietary, or otherwise.

We define “Personal Data” as any information relating to an identified or identifiable individual, including, for example, your name, phone number, post code or zip code, Device ID, IP address, and email address.

For more information, review New Relic’s General Data Privacy Notice.

Contribute

We encourage your contributions to improve opentelemetry-exporter-java! Keep in mind that when you submit your pull request, you'll need to sign the CLA via the click-through using CLA-Assistant. You only have to sign the CLA one time per project.

If you have any questions, or to execute our corporate CLA (which is required if your contribution is on behalf of a company), drop us an email at opensource@newrelic.com.

A note about vulnerabilities

As noted in our security policy, New Relic is committed to the privacy and security of our customers and their data. We believe that providing coordinated disclosure by security researchers and engaging with the security community are important means to achieve our security goals.

If you believe you have found a security vulnerability in this project or any of New Relic's products or websites, we welcome and greatly appreciate you reporting it to New Relic through HackerOne.

If you would like to contribute to this project, review these guidelines.

To all contributors, we thank you! Without your contribution, this project would not be what it is today. We also host a community project page dedicated to OpenTelemetry Exporter (Java).

License

opentelemetry-exporter-java is licensed under the Apache 2.0 License.

About

An OpenTelemetry exporter that sends telemetry to New Relic

License:Apache License 2.0


Languages

Language:Java 91.8%Language:Kotlin 7.9%Language:Shell 0.3%