Azure-Samples / openai-apim-lb

Smart load balancing for OpenAI endpoints and Azure API Management

Azure-Samples/openai-apim-lb Issues

Investigating Expression evaluation failure.
Updated 2 months ago1
Type cast error because of "remainingBackends"
Updated 2 months ago2
Plans to support dynamic routing?
Updated 4 months ago
Dropped Connections to Azure OpenAI result in APIM Cast Error
Closed 4 months ago
Retry On HTTP 401
Closed 4 months ago
Multiple APIM API Endpoints Cause Cache Cross-Contamination
Closed 4 months ago1
Fix typo
Updated 5 months ago
Adding support for multi-region and model routing capabilities
Updated 6 months ago
add this template to msft learning page
Updated 7 months ago
add example with APIM LB Pools and circuit breaker
Updated 8 months ago
Make the solution non-Python specific
Updated 8 months ago1
Wrong format of the sample code and miss azd download link in Readme
Closed 8 months ago1