getmetal / motorhead

šŸ§  Motorhead is a memory and information retrieval server for LLMs.

Home Page:https://getmetal.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support base_url for client

bdqfork opened this issue Ā· comments

Can you please support me in modifying the base_url as I am currently using some OpenAI-like services?

we're using async-openai for out client, and it seems like they support setting api_base https://docs.rs/async-openai/latest/async_openai/config/struct.OpenAIConfig.html#method.with_api_base

Is this what you're looking for? setting this as an env variable to overwrite that default api base?

also, can u please add a support for custom embedding configuration.

we're using async-openai for out client, and it seems like they support setting api_base https://docs.rs/async-openai/latest/async_openai/config/struct.OpenAIConfig.html#method.with_api_base

Is this what you're looking for? setting this as an env variable to overwrite that default api base?

Yes, I want to set this as an env variable to overwrite that default api base.