Feature Request: drop down menu for LLM provider and models

[AIGoldenfinger]

I just checked the code briefly, but I don't understand why the provider and models are hardcoded.

Would be much better and way more elegant if there is a drop down menu, that will allow to switch between the Providers and the models to be obtained from the available ones.

Currently those are hardcoded... we need to manually edit and then run the server again ...

[Genet Berhanu]

@HyperUpscale makes a great point! A dropdown for LLM providers and models would be way better than the current setup. Adding Azure OpenAI would be awesome too - it'd open up some great models like GPT-3.5-Turbo and GPT-4o. Azure OpenAI is a great choice for organizations with strict security and data privacy requirements since it keeps your data within the Azure environment. Plus, it tends to be more stable and have higher rate limits compared to the standard OpenAI API.

Here are some helpful Azure OpenAI links if anyone's interested:

• Overview
• Working with GPT-3.5 and GPT-4
• ChatGPT Quickstart

Hopefully, @jgravelle will consider it!

[J. Gravelle]

I don't disagree with any of that... https://discord.gg/DXjFPX84gs

[J. Gravelle]

Did...