oobabooga

text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

one-click-installers

Simplified installers for oobabooga/text-generation-webui.

text-generation-webui-extensions

GPTQ-for-LLaMa

4 bits quantization of LLaMa using GPTQ

oobabooga.github.io

stable-diffusion-ui

Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image.

llm-tools

Various scripts for working with local LLMs

AI-Notebooks

llama-cpp-python-cuBLAS-wheels

Wheels for llama-cpp-python compiled with cuBLAS support

audiocraft-infinity-webui

EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

roop

one-click deepfake (face swap)

SillyTavern

LLM Frontend for Power Users.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

flash-attention

Fast and memory-efficient exact attention - Windows wheels

torch-grammar

quip-sharp

alpaca_lora_4bit

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

bitsandbytes-windows-webui

Windows compile of bitsandbytes for use in text-generation-webui.

chatbot-ui

An open source ChatGPT UI.

llama-cpp-python

Python bindings for llama.cpp

minigpt-4-pipeline

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

screenshots

BlockMerge_Gradient

Merge Transformers language models by use of gradient parameters.

GPTQ-for-LLaMa-Wheels

Precompiled Wheels for GPTQ-for-LLaMa

bitsandbytes

8-bit CUDA functions for PyTorch

llama.cpp

Port of Facebook's LLaMA model in C/C++