Giters

microsoft / sample-app-aoai-chatGPT

Sample code for a simple web chat experience through Azure OpenAI, including Azure OpenAI On Your Data.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Streaming of response didn't work

stevenzhang114 opened this issue · comments

commented

Describe the bug
The result will not be showed as "streaming" type of response when generating the answers, instead will just show "Generating answer..." , and then will show whole response at the end.

To Reproduce
Steps to reproduce the behavior:

  1. Go to "Azure OpenAI studio" -> Chat playground
  2. Add data source
  3. Use "Deploy to" button to deploy a new web app
  4. Configure "AZURE_OPENAI_STREAM" variable to True
  5. Ask any questions

Expected behavior
The answer should be showing as Streaming style like when testing in Chat playground in OpenAI studio

Screenshots
If applicable, add screenshots to help explain your problem.

Configuration: Please provide the following

  • Azure OpenAI model name and version (e.g. 'gpt-35-turbo-16k, version 0613')
    gpt-4 & gpt-35-turbo-16k, version 0613
  • Is chat history enabled?
    No
  • Are you using data? If so, what data source? (e.g. Azure AI Search, Azure CosmosDB Mongo vCore, etc)
  • CosmosDB Mongo vCore

Additional context
Add any other context about the problem here.