lucenticus

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

mlc-llm

Universal LLM Deployment Engine with ML Compilation

wgpu

A cross-platform, safe, pure-Rust graphics API.

open-llms

📋 A list of open LLMs available for commercial use.

sourcegraph

Code AI platform with Code Search & Cody

starcoder

Home of StarCoder: fine-tuning & inference!

gpt-migrate

Easily migrate your codebase from one framework or language to another.

llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

tiny-dnn

header only, dependency-free deep learning framework in C++14

gfx

[maintenance mode] A low-overhead Vulkan-like GPU API for Rust.

vulkano

Safe and rich Rust wrapper around the Vulkan API

turbopilot

Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

glium

Safe OpenGL wrapper for the Rust language.

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

glutin

A low-level library for OpenGL context creation

CodeTF

CodeTF: One-stop Transformer Library for State-of-the-art Code LLM

llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

concrete

Concrete: TFHE Compiler that converts python programs into FHE equivalent

unlimiformer

Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"

Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

concrete-ml

Concrete ML: Privacy Preserving ML framework using Fully Homomorphic Encryption (FHE), built on top of Concrete, with bindings to traditional ML frameworks.

hdr10plus_tool

CLI utility to work with HDR10+ in HEVC files.

mlir-aie

An MLIR-based toolchain for AMD AI Engine-enabled devices.

CodeGen2

CodeGen2 models for program synthesis

onnx2c

Open Neural Network Exchange to C compiler.

rocMLIR

mlir-emitc

Conversions to MLIR EmitC

mlir-air

run_bug_run

The RunBugRun dataset of executable bugs