openai_api.py报错，model.generation_config无法赋值
NoobPythoner opened this issue · comments
File "/home/opensource_LLM/codeshell/demos/openai_api.py", line 251, in create_chat_completion
generation_config['temperature'] = request.temperature
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'GenerationConfig' object does not support item assignment
不好意思，我们在测试的时候确实没测试到这个功能，bug已经修复，将generation_config['temperature'] 改为generation_config.temperature即可。