Giters

timoklimmer / powerproxy-aoai

Monitors and processes traffic to and from Azure OpenAI endpoints.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Feature Request: Explicitly log model, model version and API version

krohm opened this issue · comments

commented

Hi, not an issue, but a feature request:
Is it possible to log additionally to the Calls the Model, Model Version and API-Version that was used by the call?

commented

Hi @krohm -- model and model versions can be logged indirectly already today by configuring virtual deployments. Once virtual deployments are used, the logs contain a standin deployment, which is the name of the actual deployment used. From that, you can derive model and model version. I will check if there is a better way to log model and model version.

Tracking the API version is also a good idea. I will look into it and let you know once implemented.