gptq

There are 1 repository under gptq topic.

intel / neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
auto-tuning awq fp4 gptq int4 int8 knowledge-distillation large-language-models low-precision mxformat post-training-quantization pruning quantization quantization-aware-training smoothquant sparsegpt sparsity
Language:Python 2022
LLaMA-Cult-and-More
shm007g / LLaMA-Cult-and-More
Large Language Models for All, 🦙 Cult and More, Stay in touch !
alpaca chatgpt gpt llama ggml gpt4 gptq vicuna pytorch tensorflow transformers deepspeed loralib llm
Language:HTML 421
BobaZooba / xllm
🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
alpaca bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral openai vicuna zephyr pytorch torch
Language:Python 358
1b5d / llm-api
Run any Large Language Model behind a unified API
chatgpt gptq huggingface langchain llama llamacpp llm llm-inference machine-learning python
Language:Python 147
chenhunghan / ialacol
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
ai helm kubernetes langchain llm python openai cloudnative ggml gpu llamacpp cuda gptq llm-inference llm-serving
Language:Python 141
intel / auto-round
SOTA Weight-only Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"
awq gptq int4 neural-compressor quantization rounding weight-only
Language:Python 84
abhinand5 / gptq_for_langchain
A guide about how to use GPTQ models with langchain
ai gpt gptq langchain language-model llm quantization wizardlm
Language:Jupyter Notebook 40
ziwang-com / zero-lora
zero零训练llm调参
gpt gptq llama llm lora
30
chinoll / chatsakura
ChatSakura：Open-source multilingual conversational model.（开源多语言对话大模型）
gradio pytorch bloom bloomz chatgpt instruct-gpt llm gptq transformers
Language:Python 13
tripathiarpan20 / self-improvement-4all
Private self-improvement coaching with open-source LLMs
faiss langchain python text-generation-webui gptq transformers
Language:Python 10
matlok-ai / bampe-weights
This repository is for profiling, extracting, visualizing and reusing generative AI weights to hopefully build more accurate AI models and audit/scan weights at rest to identify knowledge domains for risk(s).
ai blip2 foundational-models generative-ai gptq image-to-image llm safetensors stable-diffusion tiff transformers weights blender blender-python deep-learning
Language:Python 8
Aqirito / A.L.I.C.E
A.L.I.C.E (Artificial Labile Intelligence Cybernated Existence). A REST API of A.I companion for creating more complex system
langchain langchain-python llm text-generation text-to-speech tts vits anime artificial-intelligence genshin-impact llms otaku waifu exllama fastapi gptq huggingface-transformers pygmalion rest-api
Language:Python 4
BobaZooba / shurale
Conversation AI model for open domain dialogs
bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral natural-language-processing nlp openai pytorch torch transformers vicuna
Language:Python 4
seyf1elislam / LocalLLM_OneClick_Colab
Run gguf LLM models in Latest Version TextGen-webui
colab-notebook exllama gguf gptq llm llms localllama localllm python
Language:Jupyter Notebook 4
SujanNeupane42 / NEPSE-Chatbot-Using-Retrieval-augmented-generation-and-reranking
This project will develop a NEPSE chatbot using an open-source LLM, incorporating sentence transformers, vector database and reranking.
faiss flask gptq langchain llm python reranking-mechanism retrieval-augmented-generation sentence-transformers vector-database
Language:Jupyter Notebook 2
ElDokmak / LLMs-variety
Hands on some LLMs
llm huggingface-transformers langchain gptq llama-index openai groq llama mamba mistral mixtral
Language:Jupyter Notebook 0
SJD1882 / LLMCheatSheet
Personal GitHub repository for stashing resources on Large Language Models (LLM), including Jupyter Notebooks on open source LLMs, use-cases with Langchain and R&D paper review.
colab-notebook deep-learning large-language-models literature-review python gptq llamacpp
Language:Jupyter Notebook 0
SujanNeupane42 / LLM_Quantization
Quantizing LLMs using GPTQ
gptq huggingface llms machine-learning nlp quantization
Language:Jupyter Notebook 0