[Bug] O1 MINI使用中遇到的问题
sandycs-protoss opened this issue · comments
📦 部署方式
官方安装包
📌 软件版本
2.15.8
💻 系统环境
Windows
📌 系统版本
unknown
🌐 浏览器
Chrome
📌 浏览器版本
unknown
🐛 问题描述
使用O1模型，有概率在长信息发送后得不到回复，
提示：
{
"error": true,
"message": "empty response"
}
看不出为什么，没有日志可以查看
📷 复现步骤
No response
🚦 期望结果
No response
📝 补充信息
No response
Bot detected the issue body's language is not English, translate it automatically.
Title: [Bug] Problems encountered when using O1 MINI
应该是o1模型推理时间长了之后导致的超时
Bot detected the issue body's language is not English, translate it automatically.
It should be a timeout caused by the long inference time of the o1 model.
应该是o1模型推理时间长了之后导致的超时
确实看起来是这个问题
如果是客户端，怎么解决呢？
Bot detected the issue body's language is not English, translate it automatically.
It should be a timeout caused by the long inference time of the o1 model.
That certainly seems to be the problem
If it is a client, how to solve it?
o1 api 要支持流式了，马上就不用担心非流超时问题了
Bot detected the issue body's language is not English, translate it automatically.
The o1 api will support streaming, so you won’t have to worry about non-streaming timeouts anymore.