yangzhipeng1108 / moss-finetune-and-moss-finetune-int8

实现moss int8的finetune和优化源moss项目模型保存问题

yangzhipeng1108/moss-finetune-and-moss-finetune-int8 Issues

作者大大好，请问有尝试过moss的ptv2微调吗
Closed a year ago1
4张v100可以完成微调吗？
Closed a year ago4
如何验证微调后的结果？
Closed a year ago3
some weights of model checkpoint were not used when initializing MossForCausalLM
Closed a year ago4
请问finetune后怎么加载checkpoint，用了accelerator.save_state()方法
Closed a year ago1
NameError: name 'transpose_matmul_248_kernel' is not defined
Closed a year ago2
AttributeError: module 'transformers_modules.local.tokenization_moss' has no attribute 'MossTokenizer'
Closed a year ago7
HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name':
Closed a year ago3
能放一下训练集与验证集的实例吗
Closed a year ago1