terlar / nixcached

Nix cache daemon

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

nixcached: A Nix Cache Daemon

nixcached is a CLI that provides both a caching HTTP proxy and an asynchronous build artifact upload pipeline for Nix. It can use the local filesystem, Amazon S3, Google Cloud Storage, or any S3-compatible storage like MinIO.

Installation

nixcached is distributed as a Docker image:

docker pull ghcr.io/zombiezen/nixcached

Alternatively, if you're already using Nix, you can install the binary by checking out the repository and running the following:

nix-env --file . --install

Or if you're using Nix Flakes:

nix profile install github:zombiezen/nixcached/v0.3.3

Otherwise, you can download a static binary from the latest release.

Caching Proxy

nixcached can be run as an HTTP proxy for another Nix store. This has a number of benefits:

  • Reduces the traffic to the Nix store.
  • Opens an interactive explorer UI over your Nix store.
  • Allows privilege/credential separation from the Nix build process.
  • Ability to use native Google Cloud credentials for Google Cloud Storage.

To run nixcached as an HTTP proxy:

# Local Nix store
nixcached serve --port=8080 /nix/store
# Local folder
mkdir "$HOME/foo" && nixcached serve --port=8080 "file://$HOME/foo"
# Amazon S3
nixcached serve --port=8080 s3://nix-cache
# S3-compatible Storage
nixcached serve --port=8080 s3://mybucket?endpoint=minio.example.com:8080&disableSSL=true&s3ForcePathStyle=true
# Google Cloud Storage (GCS)
nixcached serve --port=8080 gs://nix-cache
# Remote Nix store
nixcached serve --port=8080 ssh://example.com

Upload Pipeline

nixcached can be run as an upload pipeline. This is useful for uploading build artifacts as a Nix post-build hook. To do this, run nixcached upload (either manually or using a service manager like systemd) with a named pipe as input:

mkfifo /run/nixcached-upload &&
nixcached upload -k --input=/run/nixcached-upload s3://${MY_BUCKET?}

Then in your post-build hook run nixcached send:

nixcached send -o /run/nixcached-upload $OUT_PATHS

Sending SIGHUP to nixcached upload will prevent any new paths from being received and cause the process to exit after it finishes copying any Nix store objects.

License

Apache 2.0

About

Nix cache daemon

License:Apache License 2.0


Languages

Language:Go 81.1%Language:Nix 11.6%Language:HTML 5.4%Language:Stata 1.2%Language:JavaScript 0.3%Language:Shell 0.2%Language:CSS 0.2%