horseee / LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

Home Page:https://arxiv.org/abs/2305.11627

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Examples on the Huggingface Hub

vgoklani opened this issue · comments

Apologies if this has been asked before, but do you have pruned models that we can test and run locally? Anything on the huggingface hub?

I'd like to test some of your models directly before investing time in your pruning code. Thanks!