errors when ran THUDM/chatglm3-6b on this project
kimheeyori opened this issue · comments
I ran the THUDM/chatglm3-6b model on this project and found that it reported an error: Error reported when running code: assert self. adding_ Side=="left" AssertionErro, if you have time, take a look. Thank you again.
It seems ChatGLM3-6B requires left padding which wasn't supported in the harness.
I implemented a fix in #184
It seems ChatGLM3-6B requires left padding which wasn't supported in the harness. I implemented a fix in #184
thanks a lot