A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
