oobabooga

text-generation-webui

A Gradio web UI for Large Language Models.

one-click-installers

Simplified installers for oobabooga/text-generation-webui.

text-generation-webui-extensions

GPTQ-for-LLaMa

4 bits quantization of LLaMa using GPTQ

oobabooga.github.io

llama-cpp-python-cuBLAS-wheels

Wheels for llama-cpp-python compiled with cuBLAS support

llm-tools

Various scripts for working with local LLMs

AI-Notebooks

audiocraft-infinity-webui

flash-attention

Fast and memory-efficient exact attention - Windows wheels

roop

one-click deepfake (face swap)

SillyTavern

LLM Frontend for Power Users.

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

torch-grammar

llama-cpp-python

Python bindings for llama.cpp

quip-sharp

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

bitsandbytes-windows-webui

Windows compile of bitsandbytes for use in text-generation-webui.

chatbot-ui

An open source ChatGPT UI.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

minigpt-4-pipeline

screenshots

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

BlockMerge_Gradient

Merge Transformers language models by use of gradient parameters.

GPTQ-for-LLaMa-CUDA

A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.

GPTQ-for-LLaMa-Wheels

Precompiled Wheels for GPTQ-for-LLaMa

AutoAWQ_kernels

bitsandbytes

8-bit CUDA functions for PyTorch

llama.cpp

Port of Facebook's LLaMA model in C/C++