ggerganov

llm.c

LLM training in simple, raw C/CUDA

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

magika

Detect file content types with deep learning

reor

Private & local AI personal knowledge management app.

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

LLocalSearch

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

Dot

Text-To-Speech, RAG, and LLMs. All local!

tlm

Local CLI Copilot, powered by CodeLLaMa. 💻🦙

c_std

Implementation of C++ standard libraries in C

distributed-llama

Tensor parallelism is all you need. Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

openvino-plugins-ai-audacity

A set of AI-enabled effects, generators, and analyzers for Audacity®.

LLMUnity

Create characters in Unity with LLMs!

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

nucleo-ai

An AI assistant beyond the chat box.

PureDOOM

Pure DOOM - Single Header Doom Source Port

tenere

🔥 TUI interface for LLMs written in Rust

chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

wllama

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

mamba.c

Inference of Mamba models in pure C

llama-cpp-wasm

WebAssembly (Wasm) Build and Bindings for llama.cpp

llama_cpp-rs

High-level, optionally asynchronous Rust bindings to llama.cpp

bert.cpp

GGML implementation of BERT model with Python bindings and quantization.

rk3588-npu

Reverse engineering the rk3588 npu

whisper-acft

blurt

Gnome shell extension for accurate speech to text input in Linux using whisper.cpp. Input text from speech anywhere.

gguf.js

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

whispercpp

Pybind11 bindings for Whisper.cpp

llm-eval

A super simple web interface to perform blind tests on LLM outputs.

hyllama

llama.cpp gguf file parser for javascript

emoji_finder

emoji_finder