请问10B-chinese的模型文件里为什么没有词表?
ggjge opened this issue · comments
ggjge commented
https://huggingface.co/THUDM/glm-10b-chinese/tree/main
只有tokenizer_config.json
Zhengxiao Du commented
cog-pretrain.model是sentencepiece的tokenizer模型文件
GLM (General Language Model)
ggjge opened this issue · comments
https://huggingface.co/THUDM/glm-10b-chinese/tree/main
只有tokenizer_config.json
cog-pretrain.model是sentencepiece的tokenizer模型文件