Stream Response not working

Question

Stream Response not working

NereaCassian opened this issue a year ago · comments

The responses of the AI are not being streamed

i have the ui deployed o a linux VPS with 11gigs and 8vcores

nic-foma · Answer 1 · Fri Sep 01 2023 05:27:29 GMT+0800 (China Standard Time)

I noticed streaming stopped working for me, so went back and set everything up again. It all worked fine until I enabled HTTPS (using certbot for nginx). Once I was using HTTPS streaming stopped working.

nic-foma · Answer 2 · Sat Sep 02 2023 06:14:08 GMT+0800 (China Standard Time)

This appears to be an issue when using nginx as a reverse proxy. Adding proxy_buffering off; in the location block fixed it.

Nerea Cassian · Answer 3 · Sun Sep 03 2023 00:55:07 GMT+0800 (China Standard Time)

Yep doing that solved it.