Giters
OpenBMB
/
BMCook
Model Compression for Big Models
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
137
Watchers:
6
Issues:
8
Forks:
19
OpenBMB/BMCook Issues
int8量化感知训练,保存的模型依然是fp32
Updated
6 months ago
Comments count
3
请问支持的模型有哪些?
Updated
10 months ago
使用BMCook对GLM 10B模型压缩提速推理
Updated
10 months ago
Comments count
1
the gpt example is broken
Updated
a year ago
ImportError: /home/miniconda3/envs/BMCook/lib/python3.10/site-packages/bmtrain/nccl/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol: ncclBroadcast ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 17198) of binary: /home/miniconda3/envs/BMCook/bin/python
Updated
a year ago
Comments count
3
Is there a way to do pruning/quantization without distillation?
Closed
a year ago
Comments count
3
TypeErrorTypeError: : AdamOptimizer.__init__() got an unexpected keyword argument 'scale'AdamOptimizer.__init__() got an unexpected keywo$ d argument 'scale'
Updated
a year ago
Comments count
1
AttributeError: 'BaseModelOutput' object has no attribute 'size'
Closed
2 years ago
Comments count
4