The response get cut off with the latest release
bi1101 opened this issue · comments
With the previous release, the response cut off has been fixed, however, with this release, this "quirks" came back
hey bill, can u tell me why it shows error 404 page not found when i run this - http://127.0.0.1:8080/v1/chat/completions , in terminal everything is ok, now how to get the endpoint url and key?
With the previous release, the response cut off has been fixed, however, with this release, this "quirks" came back
What's the quirk?
With the previous release, the response cut off has been fixed, however, with this release, this "quirks" came back
What's the quirk?
The fact that long response gets cut off (like with the Chat GPT webpage you have to hit continue response)
Auto continue is still enabled