OriPekelman

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

llama.cpp

LLM inference in C/C++

lollms-webui

Lord of Large Language Models Web User Interface

ollama

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

llrt

LLRT (Low Latency Runtime) is an experimental, lightweight JavaScript runtime designed to address the growing demand for fast and efficient Serverless applications.

sweep

Sweep: open-source AI-powered Software Developer for small features and bug fixes.

lockbox

Lockbox is a forward proxy for making third party API calls.

bpftime

Userspace eBPF runtime for fast Uprobe & Syscall hook & Extensions with LLVM JIT

litestack

gramine

A library OS for Linux multi-process applications, with Intel SGX support

zpoline

system call hook for Linux

runu

OCI runtime for frankenlibc unikernel

linux

Linux kernel source tree

singularity

SingularityCE is the Community Edition of Singularity, an open source container platform designed to be simple, fast, and secure.

grype

A vulnerability scanner for container images and filesystems

syft

CLI tool and library for generating a Software Bill of Materials from container images and filesystems

syft

CLI tool and library for generating a Software Bill of Materials from container images and filesystems

sbom-server

Generates SBOMs remotely in a verifiable manner (SLSA Build L3)

enclaver

Open source toolkit created to enable easy adoption of software enclaves

blindai

Confidential AI deployment with secure enclaves :lock:

enclave-cc

Process-based Confidential Container Runtime

oak

Meaningful control of data in distributed systems.

aws-nitro-enclaves-cli

Tooling for Nitro Enclave Management

inclavare-containers

A novel container runtime, aka confidential container, for cloud-native confidential computing and enclave runtime ecosystem.

shellinabox

Official-ish Fork of Shell In A Box

chisel

A fast TCP/UDP tunnel over HTTP

ssh3

SSH3: faster and rich secure shell using HTTP/3, checkout our article here: https://arxiv.org/abs/2312.08396 and our Internet-Draft: https://datatracker.ietf.org/doc/draft-michel-ssh3/

hal-9100

Edge full-stack LLM platform. Written in Rust