Can prune model convert to llama.cpp ggml?
shaonianyr opened this issue · comments
少年 commented
Can prune model convert to llama.cpp ggml?
Horseee commented
Hi, we have not tried to convert the pruned model to llama.cpp.
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.
shaonianyr opened this issue · comments
Hi, we have not tried to convert the pruned model to llama.cpp.