-
Install vector from datadog, caddy, docker and docker-compose
-
Build image Dockerfile.overlord
$ docker build -t overlord_img:latest -f Dockerfile.overlord . -
Build image Dockerfile.meili
$ docker build -t meili-img:latest -f Dockerfile.meili . -
Containers in Docker compose
- consul server
- 2 index server instances - This will register indexer instances to consul service registry
- 2 overlord instances to consul server
$ docker-compose up -
Overlord service instances are load balanced through local caddyserver
$ caddy reverse-proxy --from :3000 --to localhost:3001 --to localhost:3002 -
Run vector pipeline (Replicating log scenario for demo purposes)
- source - syslog (Demo purpose)
- transform/parse
- filter
- sink (http sink to overlord instances through lb)
$ vector -c vector-exp.toml