EKS aggregator demo with AWS load balancers and Vector source/sink
spencergilbert opened this issue · comments
Spencer Gilbert commented
Recapping a discussion with @jszwedko on modeling Vector as-an-aggregator for multiple EKS clusters.
- Each "leaf" EKS would have a Vector aggregating per cluster
- Each leaf aggregator forwards to an ALB which balances for the "central" aggregator/s with the vector sink/source
This limits the required in/out bound traffic to just Vector and a single port. Also allows for transformations/filtering at either the distributed or centralized layer.
Alternative:
- Agents in each leaf cluster forward directly to the central aggregator/s with their needed sources, and reduces configuration maintenance (but may be more complicated load balancer wise).