microsoft / azurechat

🤖 💼 Azure Chat Solution Accelerator powered by Azure Open AI Service

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

using gpt4

emmae157 opened this issue · comments

hi,

I've deployed the app in azure and when running the app, I noticed it uses gpt4 1106-preview for only text inputs and uses gpt4 vision-preview for only visual inputs. Why would it be running this way as I thought gpt4 vision-preview can take text inputs?

Also, is the chat response quite slow for anyone? When I send "hi", it takes about 3-5 seconds to respond. When it's a short paragraph, about 14-26 seconds. Long paragraphs, up to a minute

thanks

Hi @emmae157,

Yes, I have also faced a lot of latency issues when the GPT version is 1106-preview, if you switch to the GA version of GPTs (GPT-35) there are low latency issues.

hi @mkandukuri4,
thanks for your response, I'll try that

Yes, I have the same issue. There is an issue with GPT4-1106 preview. So we might have to wait for Microsoft to release final version.