UnknownHero

tabby

A terminal for a more modern age

privateGPT

Interact with your documents using the power of GPT, 100% privately, no data leaks

text-generation-webui

A Gradio web UI for Large Language Models.

dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

cursor

The AI-powered code editor

tabby

Self-hosted AI coding assistant

guidance

A guidance language for controlling large language models.

mlc-llm

Universal LLM Deployment Engine with ML Compilation

axum

Ergonomic and modular web framework built with Tokio, Tower, and Hyper

pyo3

Rust bindings for the Python interpreter

nvim-treesitter

Nvim Treesitter configurations and abstraction layer

confd

Manage local application configuration files using templates and data from etcd or consul

ml-ferret

DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself

webmin

Powerful and flexible web-based server management control panel

YaLM-100B

Pretrained language model with 100B parameters

loco

🚂 🦀 The one-person framework for Rust for side-projects and startups

openbao

OpenBao exists to provide a software solution to manage, store, and distribute sensitive data including secrets, certificates, and keys.

llvm-project

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. This fork is used to manage Apple’s stable releases of Clang as well as support the Swift project.

Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

llm-ls

LSP server leveraging LLMs for code completion (and more?)

are-copilots-local-yet

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

SillyTavern-Launcher

Launcher scripts for SillyTavern and ST-Extras.

spellbook-docker

AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models

obsidian-local-llm

Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.

aact

codeless

Use AI to craft UIs

Clover-Edition-ru

State of the art AI plays dungeon master to your adventures.