stevenrskelton / build-action-file-receiver

HTTP server that receives file uploads and verifies Maven MD5 hashes

build-action-file-receiver

Written in Scala 3, using FS2 / HTTP4s / Cats.

A light-weight HTTP server accepting file uploads, validating authenticity with GitHub Packages Maven MD5 hashes.

Run this if you have a GitHub private repo and want to get your artifacts out of GitHub CI/CD using the unlimited egress bandwidth available to GitHub Actions.

✅ Runs as fat-jar using the java -jar command Java JDK 17

     

✅ Runs as native assembly compiled with GraalVM JDK 21.0

     

🚫 Almost compiles using Scala Native 0.4.17

     

User Permissions

This application doesn't manage user permissions or security. It relies on GitHub auth tokens, and requires that:

• auth token is in HTTP request headers, and
• auth token has access to read GitHub Packages.

Since your GitHub Packages is a private repo, the auth token is secure.
All requests without a valid token, or for repos not explicitly allowed by server config will be rejected.

Do not use this for public repos. It's not needed, download the files directly from GitHub Packages.

SBT Tasks

The build-action-file-receivers.sbt file has 2 helper tasks:

• publishToGitHubPackages contains tasks to upload to GitHub Packages (Maven)
• uploadByPut contains tasks to upload to this server (HTTP PUT)

Your GitHub Action should call one of 3 tasks, depending on the artifact to be compiled:

• buildActionFileReceiverUploadAssembly for fat-jar
• buildActionFileReceiverUploadGraalNative for GraalVM native
• buildActionFileReceiverUploadScalaNative for Scala Native

These tasks are dependent on external libraries, meaning SBT plugins need to be installed in project/plugins.sbt.
If not using a particular artifact output, that SBT dependency can be omitted and the SBT task above can be removed from build-action-file-receivers.sbt to avoid compilation errors.

The SBT plugins required to be added to project/plugins.sbt are:

• addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "2.1.5") for fat-jar
• addSbtPlugin("org.scalameta" % "sbt-native-image" % "0.3.2") for GraalVM native
• addSbtPlugin("org.scala-native" % "sbt-scala-native" % "0.4.16") for Scala Native

Setup

GitHub Action Install

• Copy http-mave-receiver.sbt to the root directory of your project.
• Add plugins to project/plugins.sbt in your project.
• Copy .github/workflows/build-action-file-receiver-*.yml to the .github/workflows folder in your project.
• Create new PUT_URI environmental variable in your build-action-file-receiver-*.yml workflow, or hard-code it into the YML file in the env section.

example:

PUT_URI="http://yourdomain.com:8080/releases"

Running this GitHub Action will compile your code, upload the artifact to GitHub Packages, then upload the artifact to the PUT_URI destination, and the receiver server optionally execute a server-side script.

Server-side Receiver Install

This program is configured via command line arguments:

Command Line Arguments

• --disable-maven : Do not validate against Maven, DISABLED ALL SECURITY
• --allow-all-versions : Allow upload of non-latest versions in Maven
• --allowed-repos=[STRING] : Comma-separated list of allowed user, or user/repositories
• --host=[STRING] : Host/IP address to bind to. REQUIRED
• --port=[INTEGER] : Port to bind to. DEFAULT: 8080
• --exec=[STRING] : Command to execute after successful upload.
• --upload-directory=[STRING] : Directory to upload to. DEFAULT: "./files"

JVM example:

java -Xmx=40m -Dhost="192.168.0.1" -jar build-action-file-receiver-assembly-1.1.1.jar

GraalVM / Scala Native example:

./build-action-file-receiver --host="192.168.0.1"

Post Upload Tasks

When an exec command is specified, it will be run after a successful upload has been completed and verified. It will run in the system shell with the current directory set to the upload-directory and have the following environment variables set:

• HMV_USER : GitHub user/org
• HMV_REPOSITORY : GitHub repository
• HMV_GROUPID : Maven groupId
• HMV_ARTIFACTID : Maven artifactId
• HMV_PACKAGING : Maven packaging (eg: jar, bin)
• HMV_VERSION : Maven version
• HMV_FILENAME : Local filename

Sample

This sample script has actions depending on the artifact name, allowing it to handle multiple repositories:

Run server with --exec=script.sh. Where script.sh contains:

#!/bin/bash

if [[ $HMV_FILENAME == project-assembly-* ]] ; then
    echo "Moving $HMV_FILENAME to /home/project"
    sudo -- chown project:project $HMV_FILENAME
    sudo -- mv $HMV_FILENAME /home/project/
    echo "Successfully installed new version $HMV_FILENAME"
fi

About

See https://www.stevenskelton.ca/examples/#build-action-file-receiver for additional information.

GraalVM on MacOS M1

Uses SBT Native-Image plugin.

Uses GraalVM installed to /Library/Java/JavaVirtualMachines/graalvm-jdk-21.0.2+13.1/Contents/Home

Run nativeImageRunAgent to capture files in /META-INF/native-image/ca.stevenskelton/buildactionfilereceiver.

Run nativeImage to compile build-action-file-receiver (executable).

Scala Native

Attempting to support Scala Native compilation. See ScalaNative.md for status.