crazy-max

llama.cpp

LLM inference in C/C++

LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

colima

Container runtimes on macOS (and Linux) with minimal setup

llama2.c

Inference Llama 2 in one file of pure C

unifios-utilities

A collection of enhancements for UnifiOS based devices

finch

The Finch CLI an open source client for container development

ssh3

SSH3: faster and rich secure shell using HTTP/3, checkout our article here: https://arxiv.org/abs/2312.08396 and our Internet-Draft: https://datatracker.ietf.org/doc/draft-michel-ssh3/

incus

Powerful system container and virtual machine manager

swizzin

A simple, modular seedbox solution

mirotalksfu

🏆 WebRTC - SFU - Simple, Secure, Scalable Real-Time Video Conferences Up to 4k, compatible with all browsers and platforms.

nvidia-container-toolkit

Build and run containers leveraging NVIDIA GPUs

gorilla-cli

LLMs for your CLI

llama.go

llama.go is like llama.cpp in pure Golang!

CLBlast

Tuned OpenCL BLAS

libnvidia-container

NVIDIA container runtime library

issue-tracker-behaviors

openpubkey

Reference implementation of OpenPubkey

go-keychain

Golang keychain package for iOS and macOS

lock-threads

GitHub Action that locks closed issues, pull requests and discussions after a period of inactivity

create-github-app-token

GitHub Action for creating a GitHub App Installation Access Token

protobom

A universal SBOM representation in protocol buffers

bugsnag-go

Automatic panic monitoring for Go and Go web frameworks, like negroni, gin, and revel

echo-contrib

Echo community contribution

wsdd2

WSD/LLMNR Discovery/Name Service Daemon

lethe

Secure drive wipe

ghost

Ghost 👻 is an experimental CLI that uses AI to generate GitHub Actions workflows, using OpenAI

filepath-securejoin

Proposed filepath.SecureJoin implementation

macosx-sdks

Some Mac OS X SDKs for development purposes with osxcross.

repro-pkg-cache

Dockerfile examples for reproducing package cache (e.g., `/etc/apk/cache`)