Support websockets / SSE for langchain-serve @serving decorator
aiswaryasankar opened this issue · comments
I'm working on building out a chat application that will need to support websockets for a person to chat live with a langchain agent. The current documentation around websocket support for deploying endpoints through JINA seemed fragmented and I was told this could be supported better with the new @Serving decorator. Currently that only supports REST endpoints, would like to request support for websockets / SSE to allow for real time langchain agent response streaming.
This is supported with the pre-release version. Please install with pip install langchain-serve==0.0.2.dev24 & test the Human in the loop example.