optman

OpenHD

OpenHD

BinaryVectorDB

Efficient vector database for hundred millions of embeddings.

text-generation-inference

Large Language Model Text Generation Inference

airllm

AirLLM 70B inference with single 4GB GPU

CVinW_Readings

A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''

llama_index

LlamaIndex is a data framework for your LLM applications

nanoRWKV

RWKV in nanoGPT style

open-webui

User-friendly WebUI for LLMs (Formerly Ollama WebUI)

osh

Ollama Shell Helper (osh) : English to Unix-like Shell Commands translation using Local LLMs with Ollama

mamba-ssm

Implementation of mamba with rust

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

progress

Linux tool to show progress for cp, mv, dd, ... (formerly known as cv)

tortoise-tts

A multi-voice TTS system trained with an emphasis on quality

mlc-llm

Universal LLM Deployment Engine with ML Compilation

axolotl

Go ahead and axolotl questions

h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

mistral-inference

Official inference library for Mistral models

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

llama-dfdx

LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!

stable-diffusion-burn

Stable Diffusion v1.4 ported to Rust's burn framework

dfdx

Deep learning in Rust, with shape checked tensors and neural networks

llama2-burn

Llama2 LLM ported to Rust burn

candle

Minimalist ML framework for Rust

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

llama2.rs

A fast llama2 decoder in pure Rust.

llama2.c

Inference Llama 2 in one file of pure C

webrtc

A pure Rust implementation of WebRTC

chat-langchain