li-plus / chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Run the following command to report an error python3 chatglm3_demo.py -m ../chatglm3-ggml.bin -p 你好 --temp 0.8 --top_p 0.8

yimingchao432 opened this issue · comments

ChatGLM3-6B environment

Run the following command to report an error
python3 chatglm3_demo.py -m ../chatglm3-ggml.bin -p 你好 --temp 0.8 --top_p 0.8
error:TypeError: Pipeline.chat() got an unexpected key word argument 'max_new_tokens'