THUDM / GLM

GLM (General Language Model)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

chatglm-6b

mx8435 opened this issue · comments

commented

Hi,Is the GLM model in chatglm-6b pretrained on this repo by just modifying some tricks (such as add rope embedding, use new tokenizer), or use the GLM-130b based repo which can use megatron model-parallel. Thanks.

I also want to know the solution about this topic