Golang tool for getting zipped list of files stored in Amazon S3.
s3zipper tries to minimize memory footprint by streaming compressed data as is being downloaded, instead of a) getting, files b) compress them, and c) send compressed data.
go get github.com/gchaincl/s3zipper
AWS_ACCESS_KEY="AccessKey" AWS_SECRET_KEY="SecretKey" ./s3zipper -bucket yourBucket -port=8000
The default port will be 8000 if you don't specify another one.
Then you should specify a list of files you want to download separated by ",":
wget -O file http://localhost:8000\?files=foo.pdf,bar.pdf
- This is a proof of concept, don't expect s3zipper to be an elaborated tool
- Unexisting files will be ignored