Model list on `https://huggingface.co/second-state`
apepkuss opened this issue · comments
Summary
-
Provide k-quant models
-
Maintain existing gguf models
-
Embedding models
-
Llava models
- Qwen/Qwen-VL-Chat (Blocked by llama.cpp #5331)
- second-state/Liberated-Qwen1.5-72B-GGUF
- second-state/Yi-VL-6B
- second-state/Yi-VL-34B
- second-state/Llava-v1.6-Vicuna-7B-GGUF
- second-state/Llava-v1.5-7B-GGUF
-
Chat/instruct models
- second-state/Mistral-7B-Instruct-v0.3-GGUF
- second-state/Codestral-22B-v0.1-GGUF
- second-state/Llama-3-Instruct-8B-SimPO-GGUF
- second-state/Phi-3-medium-128k-instruct-GGUF
- second-state/Phi-3-mini-128k-instruct-GGUF
- second-state/Phi-3-medium-4k-instruct-GGUF
- second-state/Yi-1.5-9B-Chat-16K-GGUF
- second-state/Yi-1.5-34B-Chat-16K-GGUF
- second-state/Yi-1.5-34B-Chat-GGUF
- second-state/Yi-1.5-9B-Chat-GGUF
- second-state/Yi-1.5-6B-Chat-GGUF
- second-state/Llama-3-8B-Japanese-Instruct-GGUF
- second-state/StarCoder2-15B-Instruct-v0.1-GGUF
- second-state/Llama-3-8B-Instruct-Gradient-1048k-GGUF
- second-state/Llama3-8B-Chinese-Chat-GGUF
- second-state/Llama-3-8B-Instruct-262k-GGUF
- second-state/Phi-3-mini-4k-instruct-GGUF
- second-state/Llama-3-8B-Instruct-GGUF
- second-state/Meta-Llama-3-70B-Instruct-GGUF
- second-state/CodeQwen1.5-7B-Chat-GGUF
- second-state/CodeGemma-7b-it-GGUF
- second-state/gemma-1.1-2b-it-GGUF
- second-state/gemma-1.1-7b-it-GGUF
- second-state/Octopus-v2-GGUF
- second-state/C4AI-Command-R-v01-GGUF
- second-state/ChatAllInOne-Yi-34B-200K-V1-GGUF
- second-state/StarCoder2-3B-GGUF
- second-state/StarCoder2-7B-GGUF
- second-state/StarCoder2-15B-GGUF
- second-state/Gemma-7b-it-GGUF
- second-state/Gemma-2b-it-GGUF
- second-state/Yi-6B-Chat-GGUF
- second-state/Qwen1.5-0.5B-Chat-GGUF
- second-state/Qwen1.5-1.8B-Chat-GGUF
- second-state/Qwen1.5-4B-Chat-GGUF
- second-state/Qwen1.5-7B-Chat-GGUF
- second-state/Qwen1.5-14B-Chat-GGUF
- second-state/CodeLlama-70b-Instruct-hf-GGUF
- second-state/Llama-2-7B-Chat-GGUF
- second-state/Llama-2-13B-Chat-GGUF
- second-state/OpenChat-3.5-0106-GGUF
- second-state/openchat-3.5-1210-GGUF
- second-state/OpenChat-3.5-GGUF
- second-state/OpenHermes-2.5-Mistral-7B-GGUF
- second-state/Orca-2-13B-GGUF
- second-state/TinyLlama-1.1B-Chat-v1.0-GGUF
- second-state/Baichuan2-13B-Chat-GGUF
- second-state/Baichuan2-7B-Chat-GGUF
- second-state/dolphin-2.6-mistral-7B-GGUF
- second-state/Dolphin-2.7-mixtral-8x7b-GGUF
- second-state/phi-2-GGUF
- second-state/SOLAR-10.7B-Instruct-v1.0-GGUF
- second-state/Starling-LM-7B-alpha-GGUF
- second-state/Deepseek-Coder-6.7B-Instruct-GGUF
- second-state/Deepseek-LLM-7B-Chat-GGUF
- second-state/Mistral-7B-Instruct-v0.2-GGUF
- second-state/Mistral-7B-Instruct-v0.1-GGUF
- second-state/MistralLite-7B-GGUF
- second-state/Zephyr-7B-Beta-GGUF
- second-state/Zephyr-7B-Alpha-GGUF
- second-state/Neural-Chat-7B-v3-3-GGUF
- second-state/Neural-Chat-7B-v3-1-GGUF
- second-state/CodeLlama-13B-Instruct-GGUF
- second-state/ELYZA-japanese-Llama-2-13b-fast-instruct-GGUF
- second-state/WizardLM-13B-V1.0-Uncensored-GGUF
- second-state/Wizard-Vicuna-13B-Uncensored-GGUF
- second-state/WizardCoder-Python-7B-v1.0-GGUF
- second-state/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF
- second-state/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF
- second-state/stablelm-2-zephyr-1.6b-GGUF
- second-state/Yi-34B-Chat-GGUF
- second-state/Yi-34Bx2-MoE-60B-GGUF
- second-state/Dolphin-2.2-Yi-34B-GGUF
- second-state/Samantha-1.2-Mistral-7B-GGUF
- second-state/Samantha-1.11-CodeLlama-34B-GGUF
- second-state/Mixtral-8x7B-Instruct-v0.1-GGUF
- second-state/NeuralBeagle14-7B-GGUF
- second-state/OrionStar-Yi-34B-Chat-Llama-GGUF
-
-
Models blocked by issues
- second-state/Calm2-7B-Chat-GGUF (Blocked by llama.cpp #774)
- second-state/CausalLM-14B-GGUF (Blocked by llama.cpp #4958 and llama.cpp #3732)
- second-state/WizardCoder-33B-V1.1-GGUF (Blocked by llama.cpp #774)
Appendix
No response