Giters

darrenburns / elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Using 3rd-party OpenAI-compatible providers

johnd0e opened this issue · comments

commented

At the moment it is possible setting OPENAI_API_KEY / OPENAI_API_BASE variables.

But such setup does not allow to switch providers on-the-fly, or use some specific models.

Perhaps it could be implemented with some settings in config.toml.

My initial ideas:

  • Each OPENAI_API_BASE value should be separate provider, with own name.
  • The corresponding value of OPENAI_API_KEY should be stored in config.toml too.