Chorus is vendor-agnostic s3 backup, replication, and routing software. Once configured it can:
- sync existing buckets and objects from source to destination s3 storage
- capture live bucket/object changes from source s3
- propagate the changes to destination s3
Listed features can be configured per s3 user and per bucket with management CLI or webUI.
Chorus S3 Proxy service responsible for routing s3 requests and capturing data change events. Chorus Agent can be used as an alternative solution for capturing events instead of proxy. Chorus Worker service does actual data replication. Communication between Proxy/Agent and worker is done over work queue. Asynq with Redis is used as a work queue.
For more details, see:
Documentation available at docs.clyso.com.
test package contains e2e tests for replications between s3 storages. It runs:
all listed tools are written in go so test can be run without external dependencies just by:
go test ./test/...