Beast code in Giters

Vdolecek's starred repositories

llama.cpp

LLM inference in C/C++

text-generation-webui

A Gradio web UI for Large Language Models.

Language:PythonAGPL-3.039751 326 3612

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

Language:PythonApache-2.012445 133 209

koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Language:C++AGPL-3.04921 69 750

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Language:PythonMIT2739 37 219

superbig

A prompt/context management system

Language:PythonMIT164 13 4

RectifyPad

Modern Windows WordPad alternative for Windows 11

Language:CMIT152 7 11

koboldcpp

Port of Facebook's LLaMA model in C/C++

Language:C++AGPL-3.015 10

LCA

Repository for the Love Conquers All Mod for Baldur's Gate Enhanced Edition Trilogy. Crossmodding is allowed! Forking is allowed as well, pursuant to the MIT license.

Language:DTraceMIT5 1 6