colincmac / openai-client-smart-failover

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[WIP] OpenAI client-side loadbalancing and failover strategies

** This is not meant for production use, but to demonstrate different methods of loadbalancing between PTUs, Pay-as-you-go, or regional OpenAI endpoints on the client. Most documentation and guidance uses a server-side gateway.

Currently there is only one example for JavaScript. Check out the readme

Todo

About

License:MIT License


Languages

Language:TypeScript 83.7%Language:JavaScript 10.9%Language:HTML 5.4%