andredewes / apim-aoai-smart-loadbalancing

Smart load balancing for OpenAI endpoints and Azure API Management

andredewes/apim-aoai-smart-loadbalancing Issues

Error 431 - Too Large Request Header When Using Load Balancer
Updated 2 months ago
loadbalance with endpoints having different models
Closed 2 months ago
tackle multiple instance deployments with different deployment names
Updated 5 months ago1
My API's are not in the subscription and I cannot have managed identity but I have my api-key.
Updated 5 months ago
Using this or the YARP repo for Assistants API
Updated 5 months ago
Managing deployments with differing models
Closed 7 months ago4