timoklimmer / powerproxy-aoai

Monitors and processes traffic to and from Azure OpenAI endpoints.

timoklimmer/powerproxy-aoai Issues

Add Model, Model Version and API-Version used to logging
Updated in 8 hours
Experiencing PoolTimeouts
Closed in 8 hours2
Experiencing ResponseNotRead errors
Closed in 8 hours3
Feature: load-balance between instances
Closed 3 days ago1
AOAI errors not returned on streaming responses
Closed 14 days ago7
Feature: Configure HTTPX timeouts in config & Error recovery
Closed in 8 hours4
Routing issue when sending both api-key and authorization in header in v0.10.0
Closed 23 days ago3
Updated token estimation for newer models
Updated 14 days ago3
Error message when calling deployed powerproxy
Closed a month ago3
feature idea: client stream request -> proxy switch to batch -> AOAI -> proxy switch to stream response -> client
Closed 2 months ago4
adding token limits per client per model
Closed a month ago2
Error running locally
Closed 2 months ago1
Using stream causing a code: "ECONNRESET"
Closed 3 months ago2
List of Azure authorizations required for credential used to deploy
Closed 3 months ago1
[Q] Ability to use multiple deployments under same resource
Closed a month ago18
[Bug] Streaming proxy response breaks clients by `Content-Length` and `Transfer-Encoding: chunked` headers together
Closed 4 months ago
Blocking request towards client prevents "real" streaming
Closed 6 months ago5