jhc-systems / pubsubbeat

An Elastic Beat to ingest data from Google Pub/Sub

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Status: Archived

This project is no longer actively maintained by Google.


Pubsubbeat

Pubsubbeat is an elastic Beat for Google Cloud Pub/Sub. This Beat subscribes to a topic and ingest messages.

The main motivation behind the development of this plugin is to ingest Stackdriver Logs via the Exported Logs feature and send them directly to Elasticsearch ingest nodes.

This is not an officially supported Google product.

Getting Started with Pubsubbeat

Requirements

Build

To build the binary for Pubsubbeat run the command below. This will generate a binary in the same directory with the name pubsubbeat.

make

Run

To run Pubsubbeat with debugging output enabled, run:

./pubsubbeat -c pubsubbeat.yml -e -d "*"

Test

To test Pubsubbeat, run the following command:

make test

Cleanup

To clean Pubsubbeat source code, run the following commands:

make pre-commit

To clean up the build directory and generated artifacts, run:

make clean

Packaging

To build releases for available platforms:

make release

This will fetch and create binaries for all Linux, Windows and OSX

About

An Elastic Beat to ingest data from Google Pub/Sub

License:Other


Languages

Language:Go 65.2%Language:Shell 12.3%Language:Jinja 9.6%Language:Python 7.7%Language:Makefile 3.5%Language:Dockerfile 1.7%