Giters

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

errors when ran THUDM/chatglm3-6b on this project

kimheeyori opened this issue · comments

commented

I ran the THUDM/chatglm3-6b model on this project and found that it reported an error: Error reported when running code: assert self. adding_ Side=="left" AssertionErro, if you have time, take a look. Thank you again.

commented

It seems ChatGLM3-6B requires left padding which wasn't supported in the harness.
I implemented a fix in #184

commented

It seems ChatGLM3-6B requires left padding which wasn't supported in the harness. I implemented a fix in #184

thanks a lot