itchio / zipserver

🎁 A microservice that extracts a .zip file and uploads individual entries

zipserver

Zip server is an HTTP service that takes a key to a zip file on Google Cloud storage, extracts it, then reuploads the individual files to a specified prefix. It can restrict extraction of the zip file based on individual file size, total file size, or number of files.

Usage

Install

go get github.com/itchio/zipserver

zipserver -help

Create a config file:

zipserver.json:

{
	"PrivateKeyPath": "path/to/service/key.pem",
	"ClientEmail": "[e-mail]"
}

More config settings can be found in config.go

Run:

$GOPATH/bin/zipserver

Extract a zip file:

curl http://localhost:8090/extract?key=zips/my_file.zip&prefix=extracted

Slurping

You can tell the zip server to download a file from a URL. This can be used to load a zip file you want to extract later.

curl http://localhost:8090/slurp?key=myfile.zip&url=http://leafo.net/file.zip

GCS authentication and permissions

The key file in your config should be the PEM-encoded private key for a service account which has permissions to view and create objects on your chosen GCS bucket.

The bucket needs correct access settings:

• Public access must be enabled, not prevented.
• Access control should be set to fine-grained ("legacy ACL"), not uniform.