oobabooga

text-generation-webui

A Gradio web UI for Large Language Models.

one-click-installers

Simplified installers for oobabooga/text-generation-webui.

text-generation-webui-extensions

GPTQ-for-LLaMa

4 bits quantization of LLaMa using GPTQ

oobabooga.github.io

stable-diffusion-ui

Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image.

llama-cpp-python-cuBLAS-wheels

Wheels for llama-cpp-python compiled with cuBLAS support

llm-tools

Various scripts for working with local LLMs

AI-Notebooks

audiocraft-infinity-webui

flash-attention

Fast and memory-efficient exact attention - Windows wheels

EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

roop

one-click deepfake (face swap)

SillyTavern

LLM Frontend for Power Users.

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

torch-grammar

llama-cpp-python

Python bindings for llama.cpp

quip-sharp

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

bitsandbytes-windows-webui

Windows compile of bitsandbytes for use in text-generation-webui.

chatbot-ui

An open source ChatGPT UI.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

minigpt-4-pipeline

screenshots

BlockMerge_Gradient

Merge Transformers language models by use of gradient parameters.

GPTQ-for-LLaMa-CUDA

A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.

GPTQ-for-LLaMa-Wheels

Precompiled Wheels for GPTQ-for-LLaMa

bitsandbytes

8-bit CUDA functions for PyTorch

llama.cpp

Port of Facebook's LLaMA model in C/C++