VertexC / laio

An all in one log pipeline demo. From generation, collection, parsing, analysis and visualization.

LAIO: Log All In One

LAIO is a demo project, which builds up a pipeline from log generation, collection, analysis, storage and visualization.

It is also a good start point to play around Kafka and ELK stack (Actually, EBK).

Prerequisites

You need to download, config and set up local environment. Please refer to the wiki page for detailed explanation.

Reference

• Kafka Consumer Implementation: https://gist.github.com/nilsmagnus/4b582f9a36279bff5f8f9d453f8fb9c4#file-kafka_consumer-go
• ES client Implementation: https://kb.objectrocket.com/elasticsearch/how-to-insert-elasticsearch-documents-into-an-index-using-golang-451