paplorinc / text-generation-webui-colab

A colab gradio web UI for running Large Language Models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

🐣 Please follow me for new updates https://twitter.com/camenduru
πŸ”₯ Please join our discord server https://discord.gg/k5BwmmvJJU

🚦 WIP 🚦

πŸ¦’ Colab

colab Info - Model Page
Open In Colab vicuna-13b-GPTQ-4bit-128g
https://vicuna.lmsys.org
Open In Colab vicuna-13B-1.1-GPTQ-4bit-128g
https://vicuna.lmsys.org
Open In Colab stable-vicuna-13B-GPTQ-4bit-128g
https://huggingface.co/CarperAI/stable-vicuna-13b-delta

πŸ¦’ Colab Pro

According to the Facebook Research LLaMA license (Non-commercial bespoke license), maybe we cannot use this model with a Colab Pro account. But Yann LeCun said "GPL v3" (https://twitter.com/ylecun/status/1629189925089296386) I am a little confused. Is it possible to use this with a non-free Colab Pro account? If Yes

Tutorial

https://www.youtube.com/watch?v=kgA7eKU1XuA

Text Generation Web UI

https://github.com/oobabooga/text-generation-webui (Thanks to @oobabooga ❀)

Models License

Model License
vicuna-13b-GPTQ-4bit-128g From https://vicuna.lmsys.org: The online demo is a research preview intended for non-commercial use only, subject to the model License of LLaMA, Terms of Use of the data generated by OpenAI, and Privacy Practices of ShareGPT. Please contact us If you find any potential violation. The code is released under the Apache License 2.0.
gpt4-x-alpaca-13b-native-4bit-128g https://huggingface.co/chavinlo/alpaca-native -> https://huggingface.co/chavinlo/alpaca-13b -> https://huggingface.co/chavinlo/gpt4-x-alpaca

Special Thanks

Thanks to facebookresearch ❀ for https://github.com/facebookresearch/llama
Thanks to lmsys ❀ for https://huggingface.co/lmsys/vicuna-13b-delta-v0
Thanks to anon8231489123 ❀ for https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g (GPTQ 4bit quantization of: https://huggingface.co/lmsys/vicuna-13b-delta-v0)
Thanks to tatsu-lab ❀ for https://github.com/tatsu-lab/stanford_alpaca
Thanks to chavinlo ❀ for https://huggingface.co/chavinlo/gpt4-x-alpaca
Thanks to qwopqwop200 ❀ for https://github.com/qwopqwop200/GPTQ-for-LLaMa
Thanks to tsumeone ❀ for https://huggingface.co/tsumeone/gpt4-x-alpaca-13b-native-4bit-128g-cuda (GPTQ 4bit quantization of: https://huggingface.co/chavinlo/gpt4-x-alpaca)
Thanks to transformers ❀ for https://github.com/huggingface/transformers
Thanks to gradio-app ❀ for https://github.com/gradio-app/gradio
Thanks to TheBloke ❀ for https://huggingface.co/TheBloke/stable-vicuna-13B-GPTQ

About

A colab gradio web UI for running Large Language Models


Languages

Language:Jupyter Notebook 100.0%