oobabooga

open-interpreter

A natural language interface for computers

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

llamafile

Distribute and run LLMs with a single file.

flash-attention

Fast and memory-efficient exact attention

axolotl

Go ahead and axolotl questions

mergekit

Tools for merging pretrained large language models.

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

evalplus

EvalPlus for rigourous evaluation of LLM-synthesized code

AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf

quip-sharp

hqq

Official implementation of Half-Quadratic Quantization (HQQ)

llama2.py

Inference Llama 2 in one file of pure Python

alltalk_tts

AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of advanced features, such as a settings page, low VRAM support, DeepSpeed, narrator, model finetuning, custom models, wav file maintenance. It can also be used with 3rd Party software via JSON calls.

mauve

Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.

BlockMerge_Gradient

Merge Transformers language models by use of gradient parameters.

Memoir

Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.

TACO

torch-grammar

LucidWebSearch

A web search extension for Oobabooga's text-generation-webui (now with nougat)

transformers-CFG

🤗 A specialized library for integrating context-free grammars (CFG) in EBNF with the Hugging Face Transformers

chatbot_clinic

Science-driven chatbot development

text-generation-webui-stable_diffusion

Integrate image generation capabilities to text-generation-webui using Stable Diffusion.

llm-political-compass

Web page with political compass quiz results for open LLMs

echoproof

Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing the LLM's tendency to fixate on a single word, phrase, or sentence structure.

GPTQ-for-LLaMa-CUDA

A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.

flash-attention

Fast and memory-efficient exact attention - Windows wheels

ctransformers-cuBLAS-wheels

ctransformers wheels with pre-built CUDA binaries for additional CUDA and AVX versions.

text-generation-webui-output-template-extension

ChatGPT-UI

ChatGPT CSS style