Sparse Mask question
coldplayers opened this issue · comments
coldplayers commented
Hi, I have a question about the sparsity of the weight:
After merge lora into sparse weight will change sparse weight into dense?
Gongfan Fang commented
Hi @coldplayers, LLM-pruner is a structural method. After pruning, we get a dense model.
coldplayers commented
@VainF Thanks.