getzep / zep

Zep: Long-Term Memory for ‍AI Assistants.

Home Page:https://docs.getzep.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[BUG] Cannot use Azure OpenAI to create chat summaries

Semyonic opened this issue · comments

Describe the bug
When I set the ZEP_LLM_AZURE_OPENAI_ENDPOINT variable with Azure OpenAi endpoint, It fails to generate summarization and can be seen in the logs as given below in the "Logs" section

To Reproduce
Set this variable like below:

ZEP_LLM_AZURE_OPENAI_ENDPOINT=https://MY_DEPLOYMENT_NAME.openai.azure.com/openai/deployments/MY_MODEL_NAME/completions?api-version=2023-09-15-preview/chat/completions

Expected behaviour
You should be able to create summaries from chat history

Logs

time="2023-12-04T11:32:08Z" level=fatal msg="embeddings model needs to be provided when using Azure API"

Environment (please complete the following information):

  • Zep version: 0.19.0-8174c25 (2023-11-15T19:00:17+0000)
  • Zep SDK and version: zep-js v0.9.0]
  • Deployed on the Kubernetes

@Semyonic try using this part only on config.yaml

azure_openai_endpoint: https://MY_DEPLOYMENT_NAME.openai.azure.com/