Support base_url for client
bdqfork opened this issue Ā· comments
Can you please support me in modifying the base_url
as I am currently using some OpenAI-like services?
we're using async-openai for out client, and it seems like they support setting api_base https://docs.rs/async-openai/latest/async_openai/config/struct.OpenAIConfig.html#method.with_api_base
Is this what you're looking for? setting this as an env variable to overwrite that default api base?
yes @Czechh
also, can u please add a support for custom embedding configuration.
we're using async-openai for out client, and it seems like they support setting api_base https://docs.rs/async-openai/latest/async_openai/config/struct.OpenAIConfig.html#method.with_api_base
Is this what you're looking for? setting this as an env variable to overwrite that default api base?
Yes, I want to set this as an env variable to overwrite that default api base.